CN107071689B - A kind of the space audio processing method and system of direction-adaptive - Google Patents
A kind of the space audio processing method and system of direction-adaptive Download PDFInfo
- Publication number
- CN107071689B CN107071689B CN201710256740.5A CN201710256740A CN107071689B CN 107071689 B CN107071689 B CN 107071689B CN 201710256740 A CN201710256740 A CN 201710256740A CN 107071689 B CN107071689 B CN 107071689B
- Authority
- CN
- China
- Prior art keywords
- angle
- signal
- sound field
- dimensional sound
- vertical
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04S—STEREOPHONIC SYSTEMS
- H04S7/00—Indicating arrangements; Control arrangements, e.g. balance control
- H04S7/30—Control circuits for electronic adaptation of the sound field
- H04S7/305—Electronic adaptation of stereophonic audio signals to reverberation of the listening space
Abstract
The present invention relates to the space audio processing method and system of a kind of direction-adaptive, this method is that will have directive Signal separator in signal that three-dimensional sound field microphone acquires to come out；According to the smoothed out rotational angle signal that sensor acquires, rotation horizontal angle and vertical angle of the three-dimensional sound field microphone relative to former reference direction are calculated；According to the rotation horizontal angle and the deviation of vertical angle and corresponding horizontal reference angle and vertical reference angle, rotation amendment is carried out to having directive signal using spin matrix.The spatial audio signal that the present invention can be such that three-dimensional sound field microphone acquires under movement or motion state is modified to the spatial audio signal acquired under former reference direction, when to ensure that three-dimensional sound field microphone acquires spatial audio signal, it can be formed in the effect that spatial audio signal is acquired under former reference direction always.
Description
Technical field
The invention belongs to space audio acquisition and process fields, and in particular at a kind of space audio of direction-adaptive
Manage method and system.
Background technique
When Traditional Space audio signal sample, two dimension or the generally fixed position of three-dimensional sound field microphone.By sound field Mike
Wind is placed on room center and carries out sound field acquisition.When placing SoundField microphones, clear reference direction is needed.In two-dimensional case
Under, the positive direction of reference can be the direction of some microphone, therefore known to the sound field orientation for using microphone array to acquire.Three
It ties up in sound field acquisition, the reference positive direction of used SoundField microphones can be the direction of logo.It is applied in virtual reality etc.
In, panorama audio collecting device is gradually to acquisition device miniaturization, removableization development.Outdoors in equal application scenarios, sound view
Frequency acquisition equipment is often placed on picker's helmet, bicycle etc..Due to picker with equipment not necessarily always same
Direction, acquisition equipment calibration are assumed with reference to positive direction to be no longer positive direction on practical significance.Acquire removableization of equipment
But also microphone can not always be the reference positive direction of setting under the scenes such as hand-held.
Summary of the invention
A kind of space audio processing of direction-adaptive is provided it is an object of the invention to solve above-mentioned technical problem
Method and system, it is intended to when carrying out sound field recording, allow directive sound field element selectively carry out for certain
The adaptive adjustment in one direction.
To achieve the above object, the present invention adopts the following technical scheme:
A kind of space audio processing method of direction-adaptive, comprising the following steps:
It is come out having directive Signal separator in signal that three-dimensional sound field microphone acquires；
According to the smoothed out rotational angle signal that sensor acquires, three-dimensional sound field microphone is calculated relative to former reference side
To rotation horizontal angle and vertical angle；
According to the rotation horizontal angle and the deviation of vertical angle and corresponding horizontal reference angle and vertical reference angle, utilize
Spin matrix carries out rotation amendment to having directive signal.
To have directive Signal separator in signal that three-dimensional sound field microphone acquires using the method based on PCA to go out
Come.
The sensor is gravity and gyro sensor.
The object of the invention is also to provide a kind of space audio processing systems of direction-adaptive, comprising:
Separation module has directive Signal separator in the signal for acquiring three-dimensional sound field microphone and comes out；
Angle calculation module, the smoothed out rotational angle signal for being acquired according to sensor calculate three-dimensional sound field wheat
The rotation horizontal angle and vertical angle of gram wind facies for former reference direction；
Correction module is converted, for joining according to the rotation horizontal angle and vertical angle with corresponding horizontal reference angle and vertically
The deviation for examining angle carries out rotation amendment to having directive signal using spin matrix.
The separation module includes PCA processing unit, the letter for acquiring three-dimensional sound field microphone for the method based on PCA
Have directive Signal separator in number to come out.
The spin matrix includes for carrying out the modified horizontal rotation matrix of level conversion to the directive signal of tool
And for vertically being converted modified vertical spin matrix to the directive signal of tool.
The method of the present invention and system make three-dimensional sound field microphone in the case of movement, can make collected space sound
It is the purpose acquired in correct reference direction that frequency, which remains,.
Detailed description of the invention
Fig. 1 is the flow chart of the space audio processing method of direction-adaptive of the present invention；
Fig. 2 is the amendment schematic diagram that signal is acquired under three-dimensional sound field microphone situation of movement.
Specific embodiment
In the following, in conjunction with example, property feature and advantage is further described for the essence of the present invention, but the present invention not office
It is limited to listed embodiment.
As shown in connection with fig. 1, the space audio processing method of a kind of direction-adaptive, comprising the following steps:
It is come out having directive Signal separator in signal that three-dimensional sound field microphone acquires；
According to the smoothed out rotational angle signal that sensor acquires, three-dimensional sound field microphone is calculated relative to former reference side
To rotation horizontal angle and vertical angle；
According to the rotation horizontal angle and the deviation of vertical angle and corresponding horizontal reference angle and vertical reference angle, utilize
Spin matrix carries out rotation amendment to having directive signal.
Shown in Figure 1, after three-dimensional sound field microphone acquires spatial audio signal, three-dimensional sound field microphone is acquired first
Signal M1, M1 ... Mn are separated into directional ingredient M1dir、M1dir……MndirWith non-directional ingredient Mdif, then by revolving
Torque battle array calculated rotational angle using the smoothed out signal of sensor acquisition, including rotation horizontal angle and vertical angle,
To the directional ingredient M1dir、M1dir……MndirRotation amendment is carried out, revised signal M1 is formedr、M1r……Mnr,
The spatial audio signal that thus three-dimensional sound field microphone can be made to acquire under situation of movement may revert back to amendment
The case where former reference direction acquisition spatial audio signal.
Rotation horizontal angle and vertical angle of the present invention by calculating three-dimensional sound field microphone relative to former reference direction, according to
The deviation of the rotation horizontal angle and vertical angle and corresponding horizontal reference angle and vertical reference angle, using spin matrix to tool
After directive signal carries out rotation amendment, space that three-dimensional sound field microphone can be made to acquire under movement or motion state
Audio signal is modified to the spatial audio signal acquired under former reference direction, to ensure that the acquisition of three-dimensional sound field microphone is empty
Between audio signal when, can be formed in always under former reference direction acquire spatial audio signal effect.
The spatial audio signal that three-dimensional sound field microphone acquires is firstly split into the directive ingredient of tool and not by the present invention
Has directive ingredient.The advantages of this separation is that the ingredient after 1) separating can adjust two kinds of ingredients according to concrete application
Ratio.Set off atmosphere by contrast as concert environment generally requires, the ratio of non-directional ingredient can suitably be turned up.2) after separation only
There is directive ingredient to need to do the operation of adaptive direction, reduces operand.3) due to directive ingredient and not
The isolated calculation amount for having directive ingredient is relatively large, can be with by first doing this separating treatment in content manufacturing terminal
Calculation amount in effectively save playback equipment, to reduce power consumption.
Heretofore described sensor can be using gravity and gyro sensor, after releasing, directive
Ingredient can calculate according to the information of smoothed out gravity and gyro sensor sound field acquisition microphone and deviate former reference
The level angle and vertical angle of positive direction.When such as recording using SoundField microphones 10, it can first provide that SoundField microphones 10 are vertical
Under surface state, the direction on right side is with reference to positive direction.When SoundField microphones rotation, sensed according to gyroscope and gravimeter
Device obtains the angle relative to ground, to can be converted original recording to correct using spin matrix with reference to square
To as shown in Figure 2.
Specifically, the separation of directive ingredient and the ingredient without directionality, can be used based on PCA
The method of (Principal Component Analysis).Such method uses the signature analysis of cross-correlation matrix, obtains one
Spin matrix.Principal component can be acquired from input signal by spin matrix, as shown in formula (1):
E=V × Sig (1)
Wherein, E is principal component signal, and V is characterized the resulting spin matrix (being made of feature vector) of analysis, and Sig is number
It is believed that number, therefore by principal component signal E, it is subject to constant gain G appropriate, directional ingredient (Sigdirect) and it is non-directional
Ingredient (Sigdiffuse) can be separated from input signal, as shown in formula (2)-(3).
Sigdirect=G × E (2)
Sigdiffuse=Sig-G × E (3)
By gravity and the available equipment of gyro sensor relative to the rotation horizontal angle of former reference direction and vertical
Angle.Due to being calculated in real time in the present invention using needs, so the vertical angular estimation of horizontal angle is considered as real-time and stability.It is original
Sensing data in there are noises so that estimated value is swung in right value a certain range, therefore certain smoothing process needs
Consider.Level angle information such as using exponential average line smoothing method acquisition t moment after smooth.Exponential average line is smooth
Formula is
Azimuth (t)=α sensor (t)+(1- α) Azimuth (t-1) (4)
Wherein α is a parameter between 0 and 1, and sensor (t) is the level angle letter of t moment sensor output
Breath；Azimuth (t) is the level angle information after t moment is smooth.It is smooth that t moment is obtained using the smoothing method of vertical angle
Vertical angles information later:
Elevation (t)=α sensor (t)+(1- α) Elevation (t-1) (5)
The present invention is that rotation amendment is carried out according to misalignment angle when carrying out rotation amendment to directive ingredient, tool
Body is according to horizontal angle (θ) and vertical angleRelative to reference angle (θ horizontal under equipment vertical stateref) and vertical ginseng
Examine angleDeviation carry out, it includes rotating horizontally that directive ingredient needs modified spin matrix on three-dimensional each axis
Matrix and vertical spin matrix；It is as follows to rotate horizontally matrix:
Vertical spin matrix is as follows:
Therefore the conversion of the rotation by rotating horizontally matrix and vertical spin matrix, tri- axis signal of X, Y, Z of input is inclined
From can be corrected after reference direction to correct reference direction；Level amendment is as follows:
Vertical amendment is as follows:
The object of the invention is also to provide a kind of space audio processing systems of direction-adaptive, comprising:
Separation module has directive Signal separator in the signal for acquiring three-dimensional sound field microphone and comes out；
Angle calculation module, the smoothed out rotational angle signal for being acquired according to sensor calculate three-dimensional sound field wheat
The rotation horizontal angle and vertical angle of gram wind facies for former reference direction；
Correction module is converted, for joining according to the rotation horizontal angle and vertical angle with corresponding horizontal reference angle and vertically
The deviation for examining angle carries out rotation amendment to having directive signal using spin matrix.
Wherein, the separation module includes PCA processing unit, for the method based on PCA by three-dimensional sound field Mike's elegance
Have directive Signal separator in the signal of collection to come out.
It should be noted that the space audio processing system of the direction-adaptive uses the direction of front in the present invention
The technology of adaptive space audio processing method carries out the processing of space audio, and related explanation is adaptive see direction is previously with regard to
The explanation for the space audio processing method answered, details are not described herein.
It is above-mentioned about PCA processing unit, will have in signal that three-dimensional sound field microphone acquires using the method based on PCA
The method that the Signal separator of directionality comes out is shown in description described in space audio processing method of the front in relation to direction-adaptive
Method based on PCA separates the explanation of directive ingredient and the ingredient without directionality, and details are not described herein.
Wherein, the spin matrix includes for carrying out the modified horizontal rotation of level conversion to the directive signal of tool
Matrix and for vertically being converted modified vertical spin matrix to having directive signal.
It is described for carrying out the modified horizontal rotation matrix of level conversion and use to the directive signal of tool in the present invention
In to the explanation for having directive signal and vertically being converted modified vertical spin matrix, see it is above-mentioned about direction oneself
The declaratives of level matrix and vertical matrix in the space audio processing method of adaptation, details are not described herein.
As can be seen that the present invention is by calculating three-dimensional sound field microphone relative to the rotation horizontal angle of former reference direction and erecting
Right angle utilizes rotation according to the rotation horizontal angle and the deviation of vertical angle and corresponding horizontal reference angle and vertical reference angle
After torque battle array carries out rotation amendment to the directive signal of tool, it can make three-dimensional sound field microphone under movement or motion state
The spatial audio signal of acquisition is modified to the spatial audio signal acquired under former reference direction, to ensure that three-dimensional sound field wheat
When gram elegance collection spatial audio signal, it can be formed in the effect that spatial audio signal is acquired under former reference direction always.
The above is only a preferred embodiment of the present invention, it is noted that for the ordinary skill people of the art
For member, various improvements and modifications may be made without departing from the principle of the present invention, these improvements and modifications are also answered
It is considered as protection scope of the present invention.
Claims (7)
1. a kind of space audio processing method of direction-adaptive, which comprises the following steps:
It is come out having directive Signal separator in signal that three-dimensional sound field microphone acquires；
According to the smoothed out rotational angle signal that sensor acquires, three-dimensional sound field microphone is calculated relative to former reference direction
Rotate horizontal angle and vertical angle；
According to the rotation horizontal angle and the deviation of vertical angle and corresponding horizontal reference angle and vertical reference angle, rotation is utilized
Matrix carries out rotation amendment to having directive signal.
2. the space audio processing method of direction-adaptive according to claim 1, which is characterized in that using based on PCA's
Method will have directive Signal separator in signal that three-dimensional sound field microphone acquires and come out.
3. the space audio processing method of direction-adaptive according to claim 1, which is characterized in that the sensor is attached most importance to
Power and gyro sensor.
4. a kind of space audio processing system of direction-adaptive characterized by comprising
Separation module has directive Signal separator in the signal for acquiring three-dimensional sound field microphone and comes out；
Angle calculation module, the smoothed out rotational angle signal for being acquired according to sensor calculate three-dimensional sound field microphone
Rotation horizontal angle and vertical angle relative to former reference direction；
Correction module is converted, for according to the rotation horizontal angle and vertical angle and corresponding horizontal reference angle and vertical reference angle
Deviation, carry out rotation amendment to having directive signal using spin matrix.
5. the space audio processing system of direction-adaptive according to claim 4, which is characterized in that the separation module packet
PCA processing unit is included, will have directive signal point in signal that three-dimensional sound field microphone acquires for the method based on PCA
It separates out and.
6. the space audio processing system of direction-adaptive according to claim 4, which is characterized in that the spin matrix packet
It includes for carrying out the modified horizontal rotation matrix of level conversion to the directive signal of tool and for the directive letter of tool
Number vertically converted modified vertical spin matrix.
7. the space audio processing system of direction-adaptive according to claim 4, which is characterized in that the sensor is attached most importance to
Power and gyro sensor.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710256740.5A CN107071689B (en) | 2017-04-19 | 2017-04-19 | A kind of the space audio processing method and system of direction-adaptive |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710256740.5A CN107071689B (en) | 2017-04-19 | 2017-04-19 | A kind of the space audio processing method and system of direction-adaptive |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN107071689A CN107071689A (en) | 2017-08-18 |
| CN107071689B true CN107071689B (en) | 2018-12-14 |
Family
ID=59601057
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710256740.5A Active CN107071689B (en) | 2017-04-19 | 2017-04-19 | A kind of the space audio processing method and system of direction-adaptive |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107071689B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111128250A (en) * | 2019-12-18 | 2020-05-08 | 秒针信息技术有限公司 | Information processing method and device |
Family Cites Families (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2005341384A (en) * | 2004-05-28 | 2005-12-08 | Sony Corp | Sound field correcting apparatus and sound field correcting method |
| CN102752687A (en) * | 2012-06-28 | 2012-10-24 | 华为终端有限公司 | Sound effect adjusting method for terminal device and terminal device |
| CN105409241B (en) * | 2013-07-26 | 2019-08-20 | 美国亚德诺半导体公司 | Microphone calibration |
| EP2963648A1 (en) * | 2014-07-01 | 2016-01-06 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | Audio processor and method for processing an audio signal using vertical phase correction |
| CN104123950B (en) * | 2014-07-17 | 2015-11-25 | 努比亚技术有限公司 | A kind of way of recording and device |
| CN106486147A (en) * | 2015-08-26 | 2017-03-08 | 华为终端（东莞）有限公司 | The directivity way of recording, device and sound pick-up outfit |
| CN105702261B (en) * | 2016-02-04 | 2019-08-27 | 厦门大学 | Sound focusing microphone array long range sound pick up equipment with phase self-correcting function |
| CN105812976B (en) * | 2016-02-29 | 2017-05-17 | 维沃移动通信有限公司 | Earphone, method for adjusting the position of microphone on earphone, and a terminal |
| CN106375691A (en) * | 2016-08-31 | 2017-02-01 | 深圳Tcl数字技术有限公司 | Curved television video play method and apparatus |
| CN106231498A (en) * | 2016-09-27 | 2016-12-14 | 广东小天才科技有限公司 | The method of adjustment of a kind of microphone audio collection effect and device |
-
2017
- 2017-04-19 CN CN201710256740.5A patent/CN107071689B/en active Active
Also Published As
| Publication number | Publication date |
|---|---|
| CN107071689A (en) | 2017-08-18 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10397722B2 (en) | Distributed audio capture and mixing | |
| KR101724514B1 (en) | Sound signal processing method and apparatus | |
| US20170366896A1 (en) | Associating Audio with Three-Dimensional Objects in Videos | |
| JP7229925B2 (en) | Gain control in spatial audio systems | |
| CN104246531B (en) | System and method for showing user interface | |
| CN105263075B (en) | A kind of band aspect sensor earphone and its 3D sound field restoring method | |
| US11241614B2 (en) | Variable magnetic field-based position | |
| JP5016698B2 (en) | Method, apparatus and system for stabilizing a portable gesture user interface | |
| US8644531B2 (en) | Information processing system and information processing method | |
| TWI556654B (en) | Apparatus and method for deriving a directional information and systems | |
| US9491560B2 (en) | System and method for improving headphone spatial impression | |
| CN108028976A (en) | Distributed audio microphone array and locator configuration | |
| CN103336532B (en) | The support device of 3D visual-aural system and 3D visual-aural system | |
| CN104967953A (en) | Multichannel playing method and system | |
| WO2021244140A1 (en) | Object measurement method and apparatus, virtual object processing method and apparatus, medium and electronic device | |
| EP2998935B1 (en) | Image processing device, image processing method, and program | |
| EP2882180A1 (en) | Control method, control apparatus and control device | |
| CN107071689B (en) | A kind of the space audio processing method and system of direction-adaptive | |
| CN106210990A (en) | A kind of panorama sound audio processing method | |
| CN111338474A (en) | Virtual object pose calibration method and device, storage medium and electronic equipment | |
| CN111551921A (en) | Sound source orientation system and method based on sound image linkage | |
| CN105509691B (en) | The detection method of multisensor group fusion and the circular method for acoustic for supporting head tracking | |
| CN112985384A (en) | Anti-interference magnetic course angle optimization system | |
| CN111031468B (en) | Visual auxiliary method and device based on individualized HRTF stereo | |
| US20090034753A1 (en) | Direction detection apparatus, direction detection method and direction detection program, and direction control apparatus, direction control method, and direction control program |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| PP01 | Preservation of patent right | ||
| PP01 | Preservation of patent right |
Effective date of registration: 20191213 Granted publication date: 20181214 |
|
| PD01 | Discharge of preservation of patent | ||
| PD01 | Discharge of preservation of patent |
Date of cancellation: 20200306 Granted publication date: 20181214 |