Embodiment
The embodiment of embodiment one, pick-up control method.The flow process of this method as shown in Figure 3.
Among Fig. 3, S300, receive the control signal of pick up facility being carried out the pickup Region control, make the pickup zone of pick up facility be adjusted to target pickup zone by described control signal.
Optionally, the pick up facility here can include one or more microphones.The microphone here can be omnidirectional microphone or directional microphone, and a plurality of microphones can form microphone array.
Optionally, all microphones in the microphone array can be in the same plane, for example, all microphones are formed a plane polygon, and this polygon can be the regular polygon that the length of side equates, and, in polygonal center a microphone can be set.Optionally, pick up facility in the present embodiment can also be provided with a microphone specially at background sound, the background sound dedicated microphone can be positioned at same plane with other microphones in the pick up facility, also can be positioned at different planes with other microphones in the pick up facility.
Optionally, all microphones in the pick up facility also can be positioned on the Different Plane, a concrete example is: all microphones are with the distribution of shapes of many ribs vertebra, the summit of described polygonal pyramid is the position of microphone, and many ribs vertebra here can be: triangular pyramid, rectangular pyramid, pentagonal pyramid or more polygon pyramid or the like.Optionally, the bottom of pyramid can be a regular polygon, and the summit of rib vertebra can be positioned at perpendicular to regular polygon and passes on the straight line at center of regular polygon.
Optionally, the control signal of carrying out pickup Region control or adjusting of at least one microphone of above-mentioned reception can be the control signal that receives by network interface, the control signal of this moment can be based on the control signal of far-end control protocol, and network interface can be based on the IP network interface of packet switching, also can be based on Circuit-switched ISDN or E1 network interface etc.Wired (as Ethernet, xDSL, xPON) access way that the access way of network insertion can comprise and wireless (as WiFi, GSM, WiMAX) access way.
Optionally, the control signal of carrying out the pickup Region control of above-mentioned reception also can be the control signal that receives by local control interface, is that remote controller sends, passes through the local control interface control signals transmitted as the control signal that receives.Local control interface can be wireline interface (as RS232 etc.), also can be wave point (as infrared interface, blue tooth interface etc.).
Optionally, the content that the control signal among the S300 comprises can have multiple different situation, and for example, this control signal includes the information that starts pickup control; Again for example, control signal except including the information that starts pickup control, can also include adjustment step-length information, target pickup area information and the pickup control number of times of pickup control duration, pickup control isoparametric any one or a plurality of.Optionally, control signal can include the information carry out the information of pickup control or to proceed pickup control or the information in the target pickup zone that activation prestores of stopping.Above-mentioned pickup control duration can be realized by timer, promptly before the timer expiry, carries out follow-up S310 and/or S320; Work as timer expiry, then stop the execution of S310 and/or S320.Optionally, utilize the adjustment step-length information of above-mentioned pickup control can produce the pickup zone adjusting parameter in target pickup zone, but this target pickup zone might not be final objective pickup zone, and may be the interim target pickup zone in the complete pickup control procedure.Optionally, above-mentioned pickup control number of times can be realized by counter, promptly before counter reaches predetermined count value, normally carries out follow-up S310 and/or S320; When counter reaches predetermined count value, stop the execution of follow-up S310 and/or S320.The content that control signal specifically comprises has detailed illustrating in subsequent embodiment.In addition, agreement that control signal adopts and concrete form can be provided with according to actual needs, and present embodiment does not limit concrete agreement and the concrete form that control signal adopts.
S310, determine that according to described control signal the pickup zone in target pickup zone regulates parameter.
The control signal that is about to receive is converted to the pickup zone in target pickup zone and regulates parameter.
When this control signal includes the information that starts pickup control, can determine target pickup zone based on the adjustment step-length information of pickup control, for example, determine target pickup zone according to the current location and the adjustment step-length information of pick up facility microphone.At this moment, can carry out the conversion process operation that parameter is regulated in the pickup zone according to adjusting step-length information.The adjustment step-length information of the pickup control here can be the information of carrying in the control signal, also can be the information that this locality sets in advance.
Optionally, when information that includes the control of startup pickup in the control signal and pickup control duration, can be according to adjust the conversion process operation of carrying out pickup zone adjusting parameter that step-length information continues in pickup control duration, up to reaching pickup control duration, perhaps include the control signal that stops the pickup control information, thereby parameter is regulated in a plurality of pickups of the generation that can continue zone up to receiving.The adjustment step-length information of the pickup control here can be the information of carrying in the control signal, also can be the information that this locality sets in advance.
Optionally, when the information that includes the control of startup pickup in the control signal and pickup control number of times such as n (n is the integer greater than 0), can carry out the conversion process operation that n time parameter is regulated in the pickup zone according to adjusting step-length information, regulate parameter thereby can produce n pickup zone.The conversion process operation of regulating parameter in the pickup zone does not also reach n time but receives and includes the control signal that stops the pickup control information, then can no longer carry out follow-up conversion process operation.The adjustment step-length information of the pickup control here can be the information of carrying in the control signal, also can be the information that this locality sets in advance.
Optionally, when including target pickup area information in the control signal, can obtain the pickup zone according to the target pickup area information in this control signal and regulate parameter.
Optionally, in control signal, include the information that starts pickup control, but when not comprising information such as pickup control duration, target pickup area information and pickup control number of times, can include the control signal that stops the pickup control information up to receiving according to adjusting the conversion process operation of carrying out pickup zone adjusting parameter that step-length information continues.In addition, also can only carry out a regional conversion process operation of regulating parameter of pickup according to adjusting step-length information, rather than the conversion process operation of carrying out pickup zone adjusting parameter that continues.The adjustment step-length information of the pickup control here can be the information of carrying in the control signal, also can be the information that this locality sets in advance.
Parameter is regulated in the pickup zone can have multiple different form according to the difference of regulating pick up facility pickup domain mode.The content that adjusting parameter in pickup zone is comprised is enumerated explanation below.
Example 1, the method that adopts signal to synthesize are regulated pick up facility pickup zone: phase place and amplitude to a plurality of microphone picked up audio signals are handled, produce composite signal, parameter is regulated in the pickup zone can comprise that the amplitude of each microphone correspondence adjusts the weighted value of parameter and adjust the delay parameter of parameter for the phase place of the correspondence of each microphone picked up audio signals.Should be provided with a plurality of microphones in the pick up facility this moment.
Example 2, employing mechanical regulation method are regulated pick up facility pickup zone side: promptly the included microphone of pick up facility this moment has corresponding physics barrier structure respectively, this physics barrier structure is used for the pickup angle of this microphone is regulated, promptly block, make the zone of microphone picked up audio signals change by the physical location (orientation) of regulating microphone and/or the physics of regulating the microphone pickup.Can be provided with one or more microphones in the pick up facility this moment.
Example 3, adopt the synthetic and mechanical adjustment of signal in conjunction with regulating pick up facility pickup zone: pickup orientation and pickup angle (scope) part are by above-mentioned signal synthesis method adjustment, and part adopts above-mentioned mechanical regulation method adjustment.As the The Cloud Terrace adjustment mechanically of pickup orientation, the pickup angle is adjusted by the synthetic wave beam formation method of signal.
Example 4, regulate pick up facility pickup zone: utilize the auditory localization algorithm to determine whether sound source is positioned at the pickup zone of setting by sound localization method, if sound source is positioned at the pickup zone of setting, then control microphone pickup and output audio signal, if sound source is positioned at outside the pickup zone, do not carry out the pickup of audio signal or pick up this audio signal even then control microphone, but above-mentioned audio signal is not exported.Auditory localization can be adopted TDOA (Time Difference of Arrivals, arrive time delay) technology, this technology adopts the different microphone in a plurality of positions, obtain the time delay that sound arrives the diverse location microphone, try to achieve the range difference that sound arrives the diverse location microphone utilizing these time delays, determine sound source position with geometrical relationship or search at last, this method is to be widely used a kind of in the auditory localization technology, specific implementation repeats no more, be appreciated that those of ordinary skill in the art passes through the instruction and the inspiration of TDOA technology, it will also be appreciated that other auditory localization algorithm, to this, embodiments of the invention do not limit.
Above-mentionedly enumerate 4 examples of regulating pick up facility pickup domain modes and can use separately, also can applied in any combination, corresponding, above-mentionedly enumerate 4 pickups zones and regulate parameters and comprise that the example of parameter information can use separately, also can applied in any combination.
Because the difference that parameter comprises parameter information is regulated in the pickup zone, the specific implementation process that control signal is converted to the pickup zone adjusting parameter in target pickup zone also can be different, concrete transfer process has detailed example record in the following embodiments, no longer describes in detail at this.No matter conversion process is a specific implementation how, it should be that parameter is regulated in corresponding pickup zone, target pickup zone that parameter is regulated in pickup zone after the conversion, and promptly conversion principle is: parameter is regulated in the pickup zone after the conversion should make the target pickup zone corresponding with control signal, pickup zone of pick up facility conform to substantially.
S320, regulate parameter according to described pickup zone at least one microphone in the described pick up facility is carried out pickup control, thereby the pickup zone of the audio signal correspondence of pick up facility output is conformed to target pickup zone.
After promptly carrying out pickup control, pick up facility carries out pickup at target pickup zone.
First concrete example of the pickup of S320 control is: the phase place and the amplitude of regulating the audio signal that weighted value in the parameter and delay parameter pick up and export each microphone in the pick up facility according to the pickup zone in target pickup zone are adjusted, and do not belong to the audio signal in target pickup zone with filtering.
Need to prove that above-mentioned utilize amplitude adjustment parameter and phase place are adjusted the adjustment that parameter is carried out microphone, can carry out at the single microphone of pick up facility, also can carry out at a plurality of microphones of pick up facility.Wherein, single microphone at pick up facility is controlled, adjust the amplitude of the picked up audio signals of this microphone by weighted value, adjust the phase place of this microphone institute picked up audio signals by delay parameter, the audio signal that this microphone after adjusting is collected is synthesized with the signal of other microphone collections and is obtained the audio signal that final pick up facility is exported; When above-mentioned control signal is that a plurality of microphones at pick up facility are when carrying out pickup control, the weighted value of the correspondence by microphone to be adjusted is adjusted the amplitude of described microphone picked up audio signals to be adjusted, delay parameter by microphone correspondence to be adjusted is adjusted the phase place of described microphone picked up audio signals to be adjusted, the audio signal of above-mentioned adjusted each microphone is synthesized the audio signal that obtains final pick up facility output.
Need to prove, microphone is carried out audio signal to carry out after amplitude and/or phase place adjust, need the signal that each microphone in the pick up facility picks up be synthesized, it has been prior art that each microphone is carried out the signal synthetic technology, no longer gives unnecessary details at this.
Second concrete example of the pickup control of S320 is: the shift position parameter adjustment microphone shelter of the microphone pickup angle correspondence in the parameter and the relative position of microphone are regulated in the pickup zone according to target pickup zone, position as mobile shelter, the position of mobile microphone for another example, also has the position of mobile shelter and microphone.
The 3rd concrete example of the pickup control of S320 is: the position adjustments parameter of regulating the microphone place The Cloud Terrace in the parameter according to the pickup zone in target pickup zone is carried out the adjustment of level and/or pitch position to microphone place The Cloud Terrace.
The 4th concrete example of the pickup of S320 control is: the parameter of regulating the whether pickup in the parameter according to the pickup zone in target pickup zone judges that the parameter of the whether pickup of each microphone correspondence is that pickup also is non-pickup, if a microphone corresponding parameters is a pickup, then control this microphone and pick up audio signal and output, promptly can obtain this microphone picked up audio signals; If a microphone corresponding parameters is non-pickup, then can control this microphone and not pick up audio signal, perhaps do not accept this microphone picked up audio signals.
Above-mentioned four object lessons of enumerating among the S320 can be used separately, also can combination in any use.
Of particular note, in the foregoing description one the execution flow process of S310 and S320 can for: produce pickup zone and regulate parameter, carries out a pickup control, then, produce a pickup zone again and regulate parameter, carry out a pickup again and control.The execution flow process of S310 and S320 also can for: carry out pickup control successively producing the generation order of regulating parameter according to the pickup zone again after parameter is regulated in a plurality of pickups zone, in this execution flow process, if receive the control signal that stops pickup control, regulate parameter even if also have one or more pickup zones that produced but also do not had to use, also no longer carry out S320.
Optionally, after having carried out S320, can comprise: the gain to the synthetic audio signal afterwards of each microphone is adjusted.Described gain increases along with the reducing of pickup angle of described pick up facility.Can adopt existing gain to adjust implementation to the gain adjustment of audio signal, present embodiment is the specific implementation process of limiting gain adjustment not.
In addition, optionally, after having carried out S320, can also comprise: return the current pickup area information of pick up facility after pickup control to control terminal, this current pickup area information can be represented with the form of beam pattern, also can represent with forms such as orientation angles and pickup angle numerical value.A concrete example is: regulate in the application scenarios of parameter continue producing a plurality of pickups zone, whenever regulate after parameter carries out pickup control according to a pickup zone, all return corresponding beam pattern to control terminal.The control terminal here can be the network equipment that is connected with pick up facility by network interface, also can be the network equipment that is connected with pick up facility by local interface.The control terminal here can for send P/T/Z (Pan/Tilt/Zoom, promptly comprehensive (comprising: up and down, about) move and before and after control) network equipment of control signal.
From the description of the foregoing description one as can be known, the pick-up control method of embodiment one can be realized pickup control to the microphone in the pick up facility by the PTZ control signal and to the conversion process of PTZ control signal, because the PTZ control signal can be by network interface and local control interface transmission, therefore, embodiment one can realize the far-end control of pickup, is fit to be applied in the application scenarios such as video conference.The adjustment of the relative position by adopting weighted value, microphone and shelter, the horizontal and vertical position of The Cloud Terrace and whether multiple mode such as pickup microphone is carried out pickup control, not only can realize the pickup control of horizontal direction, vertical direction and angle, make the pickup control mode of pick up facility more flexible, and can carry out careful accurate control the pickup of microphone.In addition, the pick-up control method of embodiment one can well be applicable in multichannel or the monaural pick up facility.
Be that example is illustrated pick-up control method of the present invention with several concrete implementation procedures below.Because following each embodiment all has the emphasis of description, therefore, following each embodiment is applied in any combination optionally.Specific implementation process for a lot of applied in any combination no longer describes in detail.
Embodiment two, carry out pick-up control method based on the synthetic mode of signal.The principle of the pick-up control method of forming method generation of employing fixed beam and output audio signal as shown in Figure 4.
In Fig. 4, pick up facility is provided with m microphone, and m microphone output m road audio signal omitted among Fig. 4 and shown the 3 the road to m-1 road audio signal.The audio signal Y (t) of pick up facility output can be expressed as form:
Formula (1)
Wherein, X
iBe i road microphone picked up audio signals, or perhaps the i road input signal of pick up facility, Y is the audio signal of pick up facility output, w
iBe the weighted value that distributes at i road audio signal, m is the number of microphone in the pick up facility, τ
iBe to adjust parameter at the delay that i road microphone is provided with.
At the pickup control procedure of Fig. 4 can for: receive the PTZ control signal, the PTZ control signal be converted to above-mentioned weighted value w
iWith delay parameter τ
i, then, according to the weighted value w after the conversion
iWith delay parameter τ
iUtilize formula (1) to the generation composite signal, thus the audio signal output that acquisition conforms to target pickup zone.The above-mentioned PTZ control signal that receives can include the adjusting information of adjusting information, pitch orientation of horizontal direction and pickup angular adjustment information etc.The PTZ control signal is converted to weighted value w
iWith delay parameter τ
iThe specific implementation process detailed illustrating arranged in the following embodiments.
The pick-up control method of embodiment three, the adjusting step-length that pre-sets based on the employing of weighted value.Be controlled to be under the situation of microphone being carried out Z (zoom) adjusting in the pickup that the microphone to pick up facility carries out, the flow process of this method is shown in accompanying drawing 5A.
Among Fig. 5 A, S500, receive and start the Zoom regulating command,
Receive to include by network interface or local control interface and carry out the PTZ control signal that ZOOM regulates.The PTZ control signal of this moment is called startup ZOOM regulating command.Optionally, after receiving startup ZOOM regulating command, can start timer at the ZOOM regulating command, the timing length of this timer can obtain from start the ZOOM regulating command, also can obtain the canned data in advance, as adopt default timing length from this locality.
S510, regulate step delta Z according to the current pickup angle Z of pick up facility microphone and the ZOOM that pre-sets and calculate the pickup angle that the microphone needs are adjusted to.The pickup angle that microphone need be adjusted to is the corresponding pickup angle in target pickup zone.The pickup angle that microphone need be adjusted to is 2 φ, and 2 φ=Z ± Δ Z.
S520, calculate the weighted value w of each microphone in the pick up facility based on φ
i, for example, utilize φ and other calculation of parameter to go out the weighted value w of each microphone in the pick up facility
i, other parameters here can be array microphone geometric parameter, thresholding ρ and some other constraints (specifically referring to embodiment) etc.
S530, use w
iAudio signal to each microphone output of pick up facility is handled, the audio signal that the target pickup zone put down in writing among pick up facility output and the above-mentioned S510 is conformed to.
S540, the current pickup angle Z of pick up facility microphone is adjusted into 2 φ.
S550, judge whether to receive and include the PTZ control signal that stops the pickup control information by network interface or local control interface, including the PTZ control signal that stops the pickup control information can be called and stop the ZOOM regulating command, stop the ZOOM regulating command if receive, then arrive S560, otherwise, to S510, continue to carry out the adjusting of pickup angle at microphone.
Optionally, if in S500, started timer, should judge also in S550 then whether timer is overtime, no matter receives to stop ZOOM regulating command or timer expiry, then all required S560.
Optionally, after S530 or S540 or S550 or S560, can also comprise: return the beam pattern information of carrying out after ZOOM regulates to control terminal, like this, control terminal can know that following ZOOM regulates the beam pattern that changes, thereby control terminal can be judged the pickup control that whether has realized its needs according to the beam pattern that returns, after judging pickup control that has realized its needs, control terminal can send and stop the ZOOM regulating command.Certainly, above-mentioned beam pattern information also can replace with forms such as ZOOM numerical value.
S560, termination are regulated at the ZOOM of microphone.
In embodiment three, pick up facility can be provided with one or more microphones.As an example, be provided with in pick up facility under the situation of 5 microphones, the distribution of these 5 microphones can be shown in accompanying drawing 5B.The distribution of the microphone 1 among Fig. 5 B, microphone 3, microphone 4 and microphone 5 is square, and microphone 2 is positioned at foursquare center, and the arranged outside of 5 microphones has shelter--sleeve.Sleeve can move along the normal direction on plane, 5 microphone places.Though among Fig. 5 B sleeve has been shown, but the flow process shown in Fig. 5 A is not adjusted the relative position of microphone and sleeve, adjust the relative position of microphone and sleeve if desired, S520 among then above-mentioned Fig. 5 A and S530 can replace with the relative position of adjusting microphone and sleeve, for example, sleeve moves along the normal direction on plane, microphone place, because sleeve to the scope of blocking in microphone pickup zone change has taken place, therefore, the pickup angle of microphone also can change thereupon.It also is same that microphone is moved.
The foregoing description three is adjusted to example with Z and describes, P (level, promptly) regulate and the specific implementation process of specific implementation process that T (pitching, also promptly vertical up and down) regulates and above-mentioned Z adjusting basic identical, the foregoing description is to be with to weight w with adjusting in addition
iAdjusting describe, also be similar process to the adjusting of delay, The Cloud Terrace etc., in embodiment three, no longer describe in detail.
Embodiment four, based on the pick-up control method of weighted value.The present embodiment microphone distribution situation emphasis shown in the 5B is in conjunction with the accompanying drawings described the specific implementation process of determining the pickup zone adjusting parameter in target pickup zone according to the PTZ control signal.
The PTZ control signal that setting receives is to carry out the PTZ control signal that pickup is controlled respectively at the P of microphone and T.
To simplify the analysis, respectively level and vertical direction are calculated, when the P at pick up facility carries out pickup control, be reduced to a linear microphone array, adopt plane wave model, as shown in Figure 6, target source of sound and center microphone are that the line of microphone 2 and the angle of microphone array normal direction are θ, if normal direction is the initial position of former source of sound, then θ is the P deflection angle that microphone need carry out pickup control.
Set sound wave (the being audio signal) X that microphone i (i=1,2,3) receives
i(t) be expressed as with complex exponential form:
X
i(t)=e
J ω (t-(i-1) d sin θ/c)=e
J[ω t-2 π (i-1) d/ λ]Formula (2)
Wherein, ω is the angular speed of sound wave, and λ is the wavelength of sound wave, and c is the sound wave transmission speed, and d is array element distance (distance between the microphone), and the amplitude equivalence is 1.T is the time.
Setting
Situation under, above-mentioned formula (2) can be changed to:
X
i(t)=e
J[ω t-(i-1) α]Formula (3)
At this moment, the audio signal of pick up facility output is that composite signal is:
Formula (4)
In order to make composite signal, need make along θ angular direction maximum (the amplitude maximum of composite signal)
When i gets different numerical value, all equate, simultaneously, when the pickup of carrying out vertical direction at microphone is controlled, influence microphone 2, need be with delay parameter τ
2Be set to 0, therefore can get:
Formula (5)
Wherein, k and n are arbitrary integer.
If set k=n=0, then can obtain one group of design of each pick up facility delay parameter:
(6)
Similarly, after pitching (T) the pickup angle of adjusting pick up facility is η, can obtain:
Formula (7)
Wherein, d can design according to the restraint condition of reality, and for example according to the bulk restrictive condition design d of reality, the value of d can be 0.2m.
Only need just can regulate pickup direction, w in this example by postponing control
iCan design according to actual conditions, for example, w
iValue can be 1/m, wherein, m is the quantity of microphone, under the situation of 5 microphones, w
iCan be 1/5.
From the description of the foregoing description four as can be known, after the PTZ control signal that receives with θ and rotation of η corresponding horizontal and pitch regulation, obtain the delay parameter τ of each the microphone correspondence after the PTZ control signal is changed according to the method for the foregoing description four records
1~τ
5And weighted value w
i(value of i is 1 to 5) afterwards, utilizes τ
1~τ
5And w
iEach microphone picked up audio signals is handled, can be obtained the audio signal that conforms to substantially with the pickup zone of expecting (target pickup zone).
Embodiment five, utilize the rotation control mechanism of machinery to carry out pitching and/or horizontally rotate and the mode of weighted value realizes the method for pickup control.In the present embodiment, be that mechanical rotation control mechanism is that example describes pick-up control method with the The Cloud Terrace.
The Cloud Terrace shown in Fig. 7 A is provided with 5 microphones, and The Cloud Terrace can carry out moving of level and vertical direction by Stepping Motor Control, and then has changed the pickup orientation of microphone.
The pickup angle of microphone also can be adjusted among the embodiment five, for example, picks up the delay parameter and the weighted value of audio signal by the control microphone pickup angle of microphone is adjusted; Again for example, by the gain of control microphone picked up audio signals the pickup angle of microphone is adjusted.Mainly the adjustment of microphone pickup angle (ZOOM) is elaborated below.
Pickup control at the horizontal direction of the ZOOM of microphone is as follows:
Because The Cloud Terrace can rotate, therefore, the azimuthal adjustment of microphone can realize that therefore for array microphone, can be considered as θ is 0 by The Cloud Terrace, therefore, and the phase delay parameter τ of microphone
i=0, for the sound wave that becomes arbitrarily angled δ with normal, its composite signal is:
Formula (8)
The amplitude of composite signal square is:
Formula (9)
Be simplified design, can make w
1=w
3, then have
Wherein
Formula (10)
When carrying out the ZOOM adjusting, shown in accompanying drawing 7B, the pickup angle that is equivalent to the pick up facility adjustment is 2 φ, (border when sound source is positioned at pickup angle φ orientation, be two rays of representing with solid line among Fig. 7 B), the amplitude fading of composite signal is to ρ (0<ρ<1) times of normal direction (δ=0) amplitude, that is:
(1) in the use formula (11) can get:
... ... ... .... as (2w
1F (φ)+w
2)>0 formula (12)
Set w
1And w
2Greater than 0, then can get by (1) in the formula (11)
F (φ)<ρ ... ... ... .... as (2w
1F (φ)+w
2)>0 formula (13)
In order to make δ exist
In the scope during value, | Y (t) | can monotone variation, need make
Reindexing not in respective bins, thus have
The span that convolution (13) can obtain φ is constrained to:
Formula (14)
The maximum of setting φ is φ
Max, minimum value is φ
Min, then have:
Formula (15)
Because under the arrowband situation, λ is known, therefore, can determine the parameter of array microphone
Engineering for the ease of array microphone is made the span that can obtain bigger φ, and d can select higher value, for example
Certainly, d also can select to satisfy
Other values of condition.
If to w
iFurther impose restriction, then can obtain w
iA concrete example that imposes restriction is: condition ∑ w is set
i=C.
By as above describing as can be known, one group of design of the relevant parameter of the microphone in the pick up facility can be expressed as form:
As ∑ w
iDuring=C, have
When
The time, have
Be a concrete design example of the relevant parameter of the microphone in the pick up facility below:
Set
C=1, λ=0.1m,
Then the relevant parameter of the microphone in the pick up facility is:
The composite signal of pick up facility output is:
Formula (20)
If with
Be polar angle, with | Y (t) | be utmost point footpath, then can be shown in accompanying drawing 7C at the beam pattern that draws in the polar coordinate system.
From the beam pattern shown in Fig. 7 C as can be seen, spend to 360 degree (back side that is equivalent to pick up facility) 180 and can pick up audio signal yet, the back side that in actual applications can be by blocking pick up facility or the back side of hypothesis pick up facility do not have source of sound to avoid the influence of the audio signal of picking up from the back side.
If adopt and control similar mode at the pickup of the horizontal direction of the ZOOM of microphone and design at the pickup control of the vertical direction of the ZOOM of microphone, then one of the relevant parameter of the microphone in the pick up facility group of design can for:
Formula (21)
In embodiment five, because P and T adjust by The Cloud Terrace, and ZOOM adjusts by weighted value, therefore, after receiving the PTZ control signal, the PTZ control signal should be converted to PT regulating command and Z regulating command, use the PT regulating command to control moving of The Cloud Terrace, use the Z regulating command to control the ZOOM of microphone.PT regulating command such as level are regulated predetermined step-length, level left and are regulated predetermined step-length, pitching to the right to regulate predetermined step-length and pitching downwards long etc. to the adjusted predetermined steps.Above-mentioned PT regulating command and Z regulating command all belong to the pickup zone in target pickup zone and regulate parameter.
Pick up facility for multi-microphone more (m=2k+1) is formed can be easy to set up more general equation and find the solution:
Be provided with m=2k+1 microphone, numbering i is respectively-k ... 0 ... k, wherein the 0th is middle microphone, spacing is d between the microphone
Formula (22)
Can according to circumstances increase various constraint solvings for following formula, provide a kind of method for solving below:
Make w
i=w
-iCan obtain:
Wherein
Formula (23)
Order
With reference to finding the solution of front 3 microphones, can solve:
Wherein
Formula (24)
Similarly can try to achieve a conservative span
Formula (25)
Embodiment six, the pick-up control method that synthesizes based on signal fully.
In embodiment six, a plurality of microphones that pick up facility comprises not at grade, the distribution shape of a plurality of microphones is rib vertebra shape.A concrete distribution example is: the microphone 2 in 5 microphones shown in Fig. 5 B is not in same plane with other four microphones, and at this moment, can form one is the bottom surface with microphone 1,3,4 and 5, is the four rib vertebras on summit with microphone 2.Before microphone 2 is protruded in the plane at other microphone places, microphone 1,2 and 3 and the position of source of sound relation shown in accompanying drawing 8A.
Among Fig. 8 A,
microphone 1,2 and 3 constitutes an equilateral triangle, and θ is the angle between source of sound and the horizontal line, rather than the angle between source of sound and the normal, and corresponding, pickup level (P) the direction deflection angle of adjusting is
Below in conjunction with accompanying drawing 8A the pickup control of horizontal direction is described.
The composite signal of pick up facility can be expressed as:
Formula (26)
In order to make composite signal along θ angular direction maximum, promptly, need make the phase place of composite signal identical in order to make the amplitude maximum of composite signal along the θ angular direction, formula (26) wherein one group separate into:
Formula (27)
In order to make τ
i〉=0, increase a unified retardation can for all delayers, or increase one-period for some delayer (being certain delay parameter)
Do not influence the composite signal of output.
Similar with the pickup control of horizontal direction, after the pickup angle of adjusting pitching (T) is η, can obtain:
Formula (28)
Regulate to determine weight parameter according to ZOOM
wProcess be:
For become with the θ direction (sound wave at angle of δ-θ), the composite signal of pick up facility can be expressed as:
Formula (29)
According to formula (29) as can be known, for given pickup orientation θ and pickup angular range 2 φ, set when sound source is positioned at pickup angle φ orientation (δ=θ ± φ), the amplitude fading of composite signal to normal direction (δ=θ) ρ of amplitude (0<ρ<1) times, that is:
| Y (θ ± φ) |=ρ | Y (θ) |=α (w
1+ w
2+ w
3) ... .... (5) formula (30)
Utilize (5) in the formula (30) can find the solution w
i, solving result is not unique, can find the solution this constraints such as ∑ w again by increasing some constraintss
i=C etc.
At w
iUnder>0 the situation, set
C=1 then can get:
Can obtain thus a group of w separate into:
Corresponding at this moment beam pattern is shown in accompanying drawing 8B.
From the beam pattern shown in Fig. 8 B as can be seen, near some directions beyond target pickup zone (degree of 330 among Fig. 8 B) have bigger gain, in actual applications, can suppose or arrange that these zones do not have source of sound to avoid influencing target pickup zone.In addition, also can increase the number of microphone in the pick up facility, thereby effectively eliminate the influence of secondary lobe, increase number of microphone as the equilateral triangle among the figure is transformed to square or pentagon or the like.
Need to prove that the PTZ control in the embodiment of the invention is in order the describing mode of a kind of pickup Region control embodiment that the present invention adopts to be described better, also to have other control mode existence that to this, the present invention does not limit.
Embodiment seven, based on the pick-up control method of auditory localization technology.
At first, determine the sound bearing by the auditory localization algorithm, then, judge whether the sound bearing drops in the pickup zone of microphone, if drop in the pickup zone of microphone, then control microphone and carry out pickup, otherwise the control microphone does not carry out pickup or do not receive this microphone picked up audio signals.That is to say, choose the microphone that the pickup zone comprises the sound bearing, the microphone picked up audio signals that includes the sound bearing at the pickup zone is handled.
Carry out following some explanation at the foregoing description below:
Illustrate 1, can adopt several different methods to form wave beam in the various embodiments described above, for example, adopt adaptive beam forming method etc.The various embodiments described above go for the pickup control of narrow band signal, also go for the pickup control of broadband signal.For broadband signal, can adopt subband wave beam forming method, and can adopt from multiple modes such as pickup wave beam forming methods at each subband and to form wave beam.
Illustrate 2, mostly the various embodiments described above be with 5 microphones to be that example is described, and can adopt the microphone of greater number in actual applications, to reach better pickup control effect.
Illustrate 3, when the pickup zone of microphone hour, higher signal to noise ratio is arranged, promptly therefore much noise, can also carry out synchronous gain controlling to microphone corresponding audio signal, to embody near big and far smaller sensation outside the pickup zone.In actual design, also can directly make ∑ w
i=C increases along with
pickup zone 2 reducing of φ, for example, and order
K wherein is a proportionality constant.
In addition, the also Position Control that can present by sound, make the sound source position present reducing and become near with pickup zone 2 φ, make voice output embody the sensation that sound furthers, for example, the positional information after target pickup area information or the conversion can be passed to the output of audio frequency apparatus, cooperate by output and realize pickup control, for example, adopt array speaker to make the sound source position of reproduction change.
Illustrate 3, in the various embodiments described above, sound can be picked as a setting to specify the outer sound in pickup zone (being target pickup zone), can change the audio signal in target pickup zone and the proportion of background sound by the value of adjusting ρ.Wishing can to get bigger ρ value under the outstanding more situation of background sound, the sound in the outstanding target pickup zone of hope, and background sound is carried out under the situation of more filterings, can get less ρ value.A concrete example is: in embodiment three, if ρ=0.2, then Dui Ying beam pattern as shown in Figure 9; If ρ=0.7, then Dui Ying beam pattern as shown in Figure 10.
Illustrate 4, in the above-described embodiments, pick up facility can be provided with and be specifically designed to the microphone that picks up background sound, as is specifically designed to the omnidirectional microphone that picks up background sound.Can attenuation coefficient be set for being specifically designed to the microphone that picks up background sound, after the background sound that picks up being decayed according to attenuation coefficient, the composite signal stack output that the background sound after will decaying again is corresponding with other microphones.
Illustrate 5, in the above-described embodiments, use The Cloud Terrace if desired, then this The Cloud Terrace can be the The Cloud Terrace of microphone special use, also can be microphone and the shared The Cloud Terrace of camera.When microphone and the shared The Cloud Terrace of camera, can realize making a video recording and the Synchronization Control of pickup.The situation of microphone and the shared The Cloud Terrace of camera can be as shown in Figure 11.Be connected with a camera and five microphones on the The Cloud Terrace in Figure 11, five microphones are the numbering 1 to 5 that marks among Figure 11.When The Cloud Terrace level or pitching were moved, the pickup zone of the camera watch region of camera and microphone all changed simultaneously.After receiving the PTZ control signal by network interface or local control interface, the PTZ control signal can be converted to PT regulating command and ZOOM regulating command, use moving of PT regulating command control The Cloud Terrace, use the ZOOM regulating command that make a video recording control and pickup of camera and microphone controlled.In addition, can also use the shelter of microphone among Figure 11, like this, the ZOOM regulating command can be used to regulate the relative position of shelter and microphone.
Illustrate 6, in the above-described embodiments, be PTZ control signal design FMCC (Fast MicrophoneControl Criteria, the Remote Camera control command) agreement, FMCC order can be by H.224 passage carryings, also can directly be carried in the message such as TCP/UDP.Shown in following each table of a concrete example of FMCC order:
Table 1
FMCC order in the table 1 comprises N byte, and each byte comprises 8bit, corresponding 1 byte of each row of promptly showing, and first byte (command) is a command word, and second byte (device) is a device id, and the value of second byte can be 0~255.Be provided with a plurality of controlled pick up facilities in an equipment, during as a plurality of controlled microphone, can distinguish controlled pick up facility by device id, when only being provided with a controlled pick up facility in the equipment, second byte can not define.All the other bytes except that first byte and second byte are parameter, and different command word corresponding parameters also can be different, and promptly the parameter of different command can be different.The definition of the command word in the table 1 is as shown in table 2:
Table 2
The Command title |
Value |
Implication |
Start?action |
0xf1 |
Starting PTZ adjusts |
Continue?action |
0xf2 |
Continuing PTZ adjusts |
Stop?action |
0xf3 |
Stopping PTZ adjusting |
Store?preset |
0xf4 |
Storage PTZ position |
Activate?preset |
0xf5 |
The activation position that prestores |
Set?threshold |
0xf6 |
Pickup zone threshold values is set |
Send?beam?pattern |
0xe1 |
Send digital beam figure |
Having defined 6 kinds of FMCC order in the table 2, is respectively to start FMCC order that PTZ adjusts, continue FMCC order that PTZ adjusts, stop FMCC order that PTZ adjusting, the FMCC order of storage PTZ position, activate the FMCC order of the position that prestores and send the FMCC order of digital beam figure.
The FMCC order that startup pick up facility PTZ adjusts is used to trigger pick up facility and carries out pickup control, and promptly pick up facility begins to carry out pickup control after receiving the FMCC order that starts microphone PTZ adjustment.A concrete example of the FMCC order that startup microphone PTZ adjusts is as shown in table 3.
Table 3
FMCC order in the table 3 comprises four bytes.First byte is used to represent that this FMCC order is for starting the FMCC order of microphone PTZ adjustment.Second byte is a device id.The 3rd byte and nybble are as shown in table 4 below.
Table 4
Field |
Implication |
Length (bit) |
Value |
R/L |
Pan adjusts |
2 |
Not carrying out Pan adjusts: the 0x0 level is regulated left: the 0x2 level is regulated to the right: 0x3 |
U/D |
Tilt adjusts |
2 |
Not carrying out Tilt adjusts: the 0x0 pitching is regulated downwards: the 0x2 pitching is to adjusted: 0x3 |
I/O |
Zoom adjusts |
2 |
Not carrying out Zoom adjusts: 0x0 pickup zone narrows down: 0x2 pickup zone broadens: 0x3 |
BP |
Transmit beam pattern |
2 |
Do not transmit and transmit outer beam pattern: the 0x3 of transmission of beam pattern: 0x2 band in beam pattern: the 0x00 band |
Time?out |
Time-out time, above behind the time-out time, equipment stops to connect |
4 |
Numerical value 0x0~0xf is a unit with 50 milliseconds, such as |
|
Continuous adjusting is adjusted order or is started adjustment order unless receive continuation before overtime |
|
0x2 represents 100 milliseconds, and 0x8 represents 400ms |
Reserved | Reserved field | |
4 |
|
In the table 4, R/L represents the pickup control to the horizontal direction of microphone, U/D represents the pickup control to the vertical direction of microphone, I/O represents the pickup control to the ZOOM of microphone, BP represents whether to feed back beam pattern and indicates when the feedback beam pattern and feed back beam pattern in which way, Time out represents time-out time, i.e. the timing length of pickup control, and Reserved is for keeping content.
When outside the FMCC of the startup PTZ adjustment that controlled device receives orders indication to need the passback beam pattern and need be with, transmitting beam pattern (BP=0x03), controlled device can be set up media channel in addition, and utilizing this media channel of setting up in addition to transmit beam pattern, controlled device also can adopt the mode of stack beam pattern on existing image to transmit beam pattern by existing media channel.Afterwards, controlled device is closed the media channel of above-mentioned other foundation or the operation of the beam pattern that stops superposeing after receiving the FMCC order that stops the PTZ adjustment.A concrete example that transmits beam pattern is: in video conference is used, open a logical channel through consultation, to transmit beam pattern, beam pattern can adopt and H.264 wait video or the compression of coding of graphics agreement to transmit.Another the concrete example that transmits beam pattern is: in video conference was used, the stack beam pattern transmitted together on live image that video camera is caught or film content image.
When in the FMCC of the startup PTZ adjustment that controlled device receives orders indication to need the passback beam pattern and need be with, transmitting beam pattern (BP=0x02), controlled device need be by sending the FMCC order passback beam pattern information of digital beam figure, and the beam pattern information of passback can be the coordinate information of beam pattern.
The FMCC order that continues the PTZ adjustment is used to impel pick up facility to proceed pickup control, and the concrete example that the FMCC that continuation microphone PTZ adjusts orders is as shown in table 5.
Table 5
FMCC order in the table 5 comprises three bytes.First byte is used to represent that this FMCC order is for continuing the FMCC order of PTZ adjustment.Second byte is a device id.The high 4 bit Time out of the 3rd byte are used to reset the timing length of pickup control, be that pick up facility is reset timer according to the value of the Time out in the FMCC order that continues microphone PTZ adjustment, and proceed PTZ and regulate, the value of Time out can be identical with the value of Time out in the table 4.The low 4 bit Reserved of the 3rd byte are for keeping content.
The FMCC order that stops the PTZ adjustment is used to control pick up facility and no longer carries out pickup control, and promptly pick up facility stops the pickup control operation after receiving the FMCC order that stops the PTZ adjustment.A concrete example that stops the FMCC order that PTZ adjusts is as shown in table 6.
Table 6
FMCC order in the table 6 comprises two bytes.First byte is used to represent that this FMCC order is for stopping the FMCC order of PTZ adjustment.Second byte is a device id.The FMCC order that stops the PTZ adjustment can not have parameter.
The FMCC order of storage PTZ position is used to trigger pick up facility and preserves current PTZ positional information, be to obtain current PTZ positional information of each pick up facility and storage after pick up facility receives the FMCC order of storing the PTZ position, the current PTZ positional information of pick up facility can be to there being numbering, when the current PTZ information of storage microphone, the numbering of correspondence can be stored together, so that follow-up index.A concrete example of the FMCC order of storage PTZ position is as shown in table 7.
Table 7
FMCC order in the table 7 comprises three bytes.First byte is used to represent the FMCC order of this FMCC order for storage PTZ position.Second byte is a device id.The Preset number of high 4 bits of the 3rd byte represents Position Number, the span of Preset number can be 0~15, and the content of pick up facility storage can be the value of Preset number and the microphone PTZ positional information of this Preset number correspondence.The low 4 bit Reserved of the 3rd byte are for keeping content.
The prestore FMCC order of position of activation is used to trigger pick up facility and carries out pickup control according to the information that prestores, be after pick up facility receives the FMCC order that activates the position that prestores, obtain the pick up facility PTZ positional information that prestores, and carry out pickup control according to the microphone PTZ positional information that prestores.A concrete example of the FMCC order of the microphone position that activation prestores is as shown in table 8.
Table 8
FMCC order in the table 8 comprises three bytes.First byte is used to represent that this FMCC order is for activating the FMCC order of the position that prestores.Second byte is a device id.The Presetnumber of high 4 bits of the 3rd byte represents the Position Number of the microphone PTZ positional information correspondence that activates, and same, the span of Preset number can be 0~15.The low 4 bit Reserved of the 3rd byte are for keeping content.
Pickup zone threshold values is set is used to be provided with the pickup edges of regions with respect to center amplitude fading ratio, can reach the effect of the proportion of the audio signal of regulating target pickup zone and background sound, an object lesson is as shown in table 9.
Table 9
FMCC order in the table 9 comprises three bytes.First byte is used to represent that this FMCC order is for being provided with the FMCC order of pickup zone threshold values.Second byte is a device id.The Threshold of high 4 bits of the 3rd byte represents to be provided with the pickup edges of regions with respect to center amplitude fading ratio, and span can be 1~9, respectively correspondence 0.1~0.9.The low 4 bit Reserved of the 3rd byte are for keeping content.
The FMCC order that sends digital beam figure is used for pick up facility and feeds back beam pattern to control terminal, for example, controlled device is after receiving the FMCC order that starts microphone PTZ adjustment, if transmit beam pattern in the BP in this FMCC order represents to be with, then controlled device generates beam pattern according to the current pickup zone of pick up facility, and utilizes the FMCC order that sends digital beam figure to send beam pattern.A concrete example of the FMCC order of transmission digital beam figure is as shown in table 10.
Table 10
FMCC order in the table 10 comprises N byte.First byte is used to represent that this FMCC order is for sending the FMCC order of digital beam figure.Second byte is a device id.The 3rd byte is used to represent the numerical value of pick up facility present level direction, and nybble is used to represent the numerical value of the current vertical direction of pick up facility.The 5th byte is used to the ZOOM that represents that pick up facility is current.The 6th byte and the 7th byte are used to represent counting of beam pattern.The Eight characters is saved in the precision of expression beam pattern.The 9th byte is used to represent the compress mode of beam pattern.Description in subsequent byte such as the table 10.
When controlled device returns beam pattern in carrying out band, both can only transmit the P/T/Z angle information, also can only transmit beam pattern, can also the two transmit simultaneously.In addition, the controlled device describing mode that also beam pattern can be converted to rectangular coordinate transmits.The beam pattern here can adopt the polar coordinate mode pointwise to describe.Controlled device can utilize this FMCC order to transmit sparse or fine and close beam pattern as required, and the sparse or fine and close value by n is here determined.The receiving terminal of received beam figure can carry out the interpolation smoothing processing with the beam pattern that receives.
Also can realize at the transmission of the PTZ control signal of pick up facility and the transmission of beam pattern by the mode that in the order of (as agreement H.281) of existing video camera control protocol, increases field.
When video camera and pick up facility carry out PTZ when adjusting simultaneously, video camera can be followed pick up facility and be carried out PTZ and adjust, and not be used in independent transmission video camera control command; Pick up facility also can controlled terminal be set follows video camera and carries out PTZ and adjust, so just can use existing video camera control protocol to adjust the PTZ position of pick up facility simultaneously, also can in the order of video camera control protocol, indicate pick up facility and follow video camera and regulate (need expand so that pick up facility is set the video camera control protocol and follow the video camera adjustment), perhaps also can indicate pick up facility by independent negotiation and follow video camera and regulate; Control terminal also can send the synchronous adjustment that realizes the two at the control command of video camera with at the control command of pick up facility simultaneously.
The order of the PTZ control signal by local control interface transmission is similar substantially to foregoing description, no longer the command format of the PTZ control signal transmitted by local control interface is elaborated here.
The present invention also provides a kind of embodiment of pickup control device, and referring to Figure 12, this pickup control device comprises:
Receiver module 1201 is used to receive at pick up facility and carries out the control signal that the pickup zone is regulated, and makes the pickup zone of pick up facility be adjusted to target pickup zone by described control signal;
Parameter determination module 1202 is used for determining that according to described control signal the pickup zone in target pickup zone regulates parameter;
Pickup zone adjustment module 1203 is used for regulating parameter according to described pickup zone at least one microphone of described pick up facility is carried out pickup control, and the pickup zone of the audio signal correspondence of described pick up facility output is conformed to described target pickup zone.
Optionally, referring to Figure 13, described device also comprises as lower module:
Pickup control stopping modular 1204, be used to receive include the control signal that stops the pickup control information after, stop the reception of pickup control signal.
Can receive pickup by embodiments of the invention pickup control appliance and stop control messages, make things convenient for user's operation control.
Optionally, referring to Figure 14, described parameter determination module 1202 specifically comprises: signal transformation parameter determination module 1205 is used for definite parameter that the signal that at least one microphone picked up of described pick up facility is carried out signal transformation;
Described pickup zone adjustment module 1203 comprises:
Parameter transformation unit 12031 is used for that the microphone picked up audio signals of pending audio signal adjustment is carried out corresponding conversion and obtains changing signal afterwards;
Synthesis unit 12032 is used for the signal through the microphone after the parameter transformation of described pick up facility is synthesized, and obtains the audio signal of described pick up facility output.
Adopt embodiments of the invention can get access to corresponding audio signal transformation parameter, institute's picked up audio signals of pick up facility is carried out conversion, effectively solved the problem that can't realize the control of pick up facility in the prior art by extraneous control signal.
Optionally, referring to Figure 15, described parameter of carrying out signal transformation is: the amplitude of at least one microphone correspondence is adjusted parameter and/or phase place adjustment parameter in the described pick up facility;
Described parameter determination module 1202 specifically comprises: adjust parameter determination module 1206, be used for determining the amplitude adjustment parameter and/or the phase place adjustment parameter of at least one microphone correspondence of described pick up facility;
Described pickup zone adjustment module 1203 comprises:
Parameter transformation unit 12033 is used for utilizing described amplitude to adjust parameter and/or phase place and adjusts parameter at least one microphone of described pick up facility is carried out amplitude adjustment and/or phase place adjustment;
Synthesis unit 12034 is used for the signal through the microphone of parameter transformation of described pick up facility is synthesized, and obtains the audio signal of described pick up facility output.
Wherein, by the parameter that the weighted value among the method embodiment of the present invention is adjusted as audio frequency signal amplitude, adjust parameter as the phase place of the picked up audio signals of pick up facility by delay parameter.
Embodiments of the invention, realize the pick up facility picked up audio signals is carried out the control of amplitude adjustment and/or phase place adjustment by obtaining outside pickup Region control signal, effectively solved the problem of the interface chemical control system that can't realize pick up facility of prior art existence.
Optionally, referring to Figure 16, described parameter of carrying out signal transformation is: at least one microphone of described pick up facility carries out the position moving parameter of translation and/or rotation;
Described parameter determination module 1202 specifically comprises: position moving parameter determination module 1207 is used for the position moving parameter of determining that at least one microphone of described pick up facility carries out translation and/or rotation;
Described pickup zone adjustment module 1203 specifically comprises:
Control unit 12035, the position moving parameter that is used for utilizing described translation and/or rotation carries out translation and/or rotates control at least one microphone of described pick up facility, makes each microphone of accepting control reach the position moving parameter determined position corresponding with each microphone.
Optionally, referring to Figure 17, above-mentioned described control unit 12035 comprises:
Translation position control unit 120351, be used for moving at least one microphone and/or the shelter of regulating the described pick up facility of parameter adjustment, with the relative position of the relative shelter of at least one microphone of adjusting described pick up facility according at least one microphone translation position of described pick up facility;
Turned position control unit 120352 is used for moving according to described turned position and regulates parameter at least one microphone of described pick up facility is carried out level angle and/or luffing angle adjustment.
Pass through embodiments of the invention, can realize the microphone that is comprised in the pick up facility is carried out the function of position adjustments, promptly can realize the translation control and/or the rotation of the microphone that pick up facility comprised are controlled according to the pickup Region control signal of outside, by effective control, can effectively regulate the pickup zone of pick up facility to the microphone of pick up facility.
Optionally, referring to Figure 18, described parameter of carrying out signal transformation is: whether at least one microphone of described pick up facility the parameter of pickup;
Described parameter determination module 1202 specifically comprises: pickup determination module 1208, and whether at least one microphone that is used for determining described pick up facility the parameter of pickup;
Described pickup zone adjustment module 1203 comprises: be used for determining target pickup zone according to described control signal, and determine the position of sound source according to the auditory localization algorithm; Whether the position of judging described sound source is positioned at described target pickup zone, if it is that pickup is confirmed parameter that parameter is regulated in then described pickup zone, otherwise is that non-pickup is confirmed parameter;
When described pick up facility gets access to pickup affirmation parameter, control at least one microphone picked up audio signals of described pick up facility, otherwise at least one microphone of controlling described pick up facility does not carry out picking up of audio signal or at least one microphone institute picked up audio signals of described pick up facility is not obtained.
Whether embodiments of the invention can carry out pickup to pick up facility and effectively control, and having solved can't be by obtaining the problem that external parameter carries out the adjustment of pickup zone and pickup signal in the prior art.
Optionally, when the microphone number of described pick up facility is at least four, all microphones distribute at grade, perhaps other microphones except that first microphone of pick up facility are the polygon distribution, and first microphone of described pick up facility and described other microphones are polygonal pyramid shape and distribute.
Present embodiment provides the layout type of a plurality of microphones of pick up facility, by different layout type, can effectively control the pickup zone.
Wherein, the sine value of the maximum pickup angle of the maximum of the spacing of two microphones arbitrarily of described pick up facility and described single microphone is inverse ratio.
Optionally, described pick up facility also is provided with and is exclusively used in the microphone that picks up background sound, the background sound that the described microphone that is used to pick up background sound picks up through after the overdamping with described pickup control after the audio signal stack.
Wherein, described pickup control device also comprises: the background sound adjustment module, the control signal that is used for regulating from pickup zone extracts and is used for controlling the Control Parameter of background sound than re-correlation, according to this Control Parameter at least one microphone of described pick up facility is carried out pickup control, make the audio signal background sound proportion respective change of output.
Can effectively change by embodiments of the invention and can't realize in the prior art that the audio signal that pick up facility is obtained carries out the adjusting problem of foreground voice and background sound, by embodiments of the invention, can
Figure 19 is a realization technical scheme block diagram of the present invention, wherein
Microphone unit comprises one or for a plurality of (array) directional microphones and/or the Mike of omnidirectional;
Network interface is used for receiving by network the PTZ control command to microphone of far-end, network interface can be based on the IP network of packet switching or Circuit-switched ISDN, E1 network, comprise wired (as Ethernet, xDSL etc.) and wireless (as WiFi, WiMAX, UMTS, CDMA2000, TD-SCDMA) access way, realize the control of far-end pick up facility by the far-end control protocol;
Local control interface is used to receive local PTZ control command to microphone, and interface can be wired or wireless interfaces such as infrared, bluetooth, RS232, finishes the control of local pick up facility by the control protocol of this locality;
The PTZ control unit is converted to pickup zone regulon and the required parameter of The Cloud Terrace (optional) with the PTZ control signal;
Pickup zone regulon carries out the processing such as weighting of phase place and amplitude, the audio signal of output and PTZ corresponding region, the extra-regional signal of filtering to the digital audio and video signals of array microphone input.Pickup zone regulon also can adopt the mode in the prior art 1 to carry out ZOOM and regulate, and regulates the pickup angle by hiding relation, mechanically replaces array microphone to carry out ZOOM and regulates;
The Cloud Terrace (optionally), mechanically the substitute array microphone carries out the adjustment of level (P) and pitching (T);
The audio adjustment unit further carries out the amplification (can be synchronous with video scaling) of sound, background sound special processing etc.
In the practical adjustments process, for real-time feedback effects can be arranged, can adopt continuous regulative mode, be that the user sends an order that starts adjusting, the PTZ control module is just regulated parameter (is increment with certain step-length) with the generation that certain frequency continues, and sends the order that stops to regulate up to the user.
Through the above description of the embodiments, those skilled in the art can be well understood to the present invention and can realize by the mode that software adds essential hardware platform, can certainly all implement, but the former is better execution mode under a lot of situation by hardware.Based on such understanding, all or part of can the embodying that technical scheme of the present invention contributes to background technology with the form of software product, this computer software product can be stored in the storage medium, as ROM/RAM, magnetic disc, CD etc., comprise that some instructions are with so that a computer equipment (can be a personal computer, server, the perhaps network equipment etc.) carry out the described method of some part of each embodiment of the present invention or embodiment.
Though described the present invention by embodiment, those of ordinary skills know, the present invention has many distortion and variation and do not break away from spirit of the present invention, and the claim of application documents of the present invention comprises these distortion and variation.