CN102137318B - Method and device for controlling adapterization - Google Patents

Abstract

The embodiment of the invention discloses a method and a device for controlling adapterization. The method for controlling adapterization comprises the following steps of: receiving a control signal for controlling an adapterization region aiming at adapterization equipment, and regulating the adapterization region of the adapterization equipment to a target adapterization region by the control signal; determining an adapterization region regulation parameter of the target adapterization region according to the control signal; and performing adapterization control on at least one microphone of the adapterization equipment according to the adapterization region regulation parameter so that the adapterization region corresponding to an audio signal output by the adapterization equipment accords with the target adapterization region. By the technical scheme, the adapterization control over the microphone of the adapterization equipment can be realized by the control signal and the conversion process of the control signal; moreover, as the control signal can be transmitted through a network interface and a local control interface, the interface control over the adapterization equipment is realized.

Description

Pick-up control method and device

Technical field

The present invention relates to multimedia technology field, be specifically related to pick-up control method and device.

Background technology

When using video conference, often need to control picking up the region of sound, for example, certain sound is furthered (amplification), for another example, avoid noise source etc.; To reach better video conference effect.At present, mainly contain two kinds of pick-up control methods.

Method one, the pick-up control method based on controlling the position of microphone in cylinder shelter.

There is the camera structure of optics and acoustics synchronous " focusing " as shown in Figure 1.Microphone in Fig. 1 (11) is arranged in cylinder shelter (12), and when adjusting optical lens angle (zoom), the position of microphone (11) in cylinder shelter also can change thereupon, thereby realized pickup control.

In realizing process of the present invention, inventor finds: the pickup of method one is controlled to control to synchronize with image pickup and carried out, and can not independently carry out pickup control; And because microphone (11) can only move forward and backward in cylinder shelter (12), therefore only realized zoom adjustment, can not carry out the adjustment of horizontal and vertical direction, can not produce the variation of position sense, and because the sound outside pickup angle can not enter microphone (11), therefore can not process flexibly background sound and foreground voice etc.; In addition, method one can not be applicable in many Mikes' pickup environment, and can not carry out the interfaceization control of pickup.

Method two, the pick-up control method based on left and right acoustic channels output.The Fig. 2 of take below describes method two as example.

The 16aHe 16bShi Liangge MIC of omnidirectional (Mike) in Fig. 2, by the gain of control amplifier 19a, 19b and 19c, realizes the zoom of MIC is controlled.For example, in the time the zoom of MIC need to being adjusted into " wide-angle ", zoom control section (12) can 19a and the gain of 19b be set to 1 maximumly, the gain of 19c is set to 0; In the time the zoom of MIC need to being adjusted into " furthering ", zoom control section (12) can 19a and the gain of the 19b gain that is set to 0,19c be set to 1.Like this, utilize left and right acoustic channels output to realize wide-angle/further.

In realizing process of the present invention, inventor finds: method two has only been realized zoom adjustment, can not carry out the adjustment of horizontal and vertical direction, can not produce the variation of position sense, and zoom adjusts more extensive; In addition, method two must be exported and be realized pickup and control by dual track, can not be applicable in monaural pickup environment, and the interfaceization that can not carry out pickup is controlled.

In summary it can be seen, prior art cannot be carried out the control of pickup region interface to pick up facility, can not meet the demand for control of user flexibility.

Summary of the invention

The pick-up control method that embodiment of the present invention provides and device, control with the interface of having realized in pickup process.

The pick-up control method that embodiment of the present invention provides, comprising: receive the control signal of carrying out pickup Region control for pick up facility, by described control signal, make the pickup region of pick up facility be adjusted to target pickup region;

The pickup region of determining target pickup region according to described control signal regulates parameter;

According to described pickup region, regulate parameter to carry out pickup control at least one microphone in described pick up facility, the pickup region corresponding to audio signal of described pick up facility output conformed to described target pickup region.

On the other hand, also provide a kind of pickup control device, this device comprises:

Receiver module, for receiving the control signal of carrying out the adjusting of pickup region for pick up facility, makes the pickup region of pick up facility be adjusted to target pickup region by described control signal;

Control module, determines that according to described control signal the pickup region in target pickup region regulates parameter;

Pickup region adjustment module, regulates parameter to carry out pickup control at least one microphone of described pick up facility according to described pickup region, and the pickup region corresponding to audio signal of described pick up facility output conformed to described target pickup region.

Description by technique scheme is known, the embodiment of the present invention is by receiving for the pickup Region control signal of pick up facility and determining that by this pickup Region control signal the pickup region in target pickup region regulates parameter to realize the pickup of the microphone in pick up facility is controlled, and embodiments of the invention can make the convenient pickup region to pick up facility of user control easily.

Accompanying drawing explanation

Fig. 1 is the schematic diagram of the pick-up control method one of prior art;

Fig. 2 is the schematic diagram of the pick-up control method two of prior art;

Fig. 3 is the pick-up control method flow chart of the embodiment of the present invention one;

Fig. 4 is the principle schematic of the pick-up control method based on weight of the embodiment of the present invention two;

Fig. 5 A is the pick-up control method flow chart of the embodiment of the present invention three;

Fig. 5 B is the microphone distribution schematic diagram of the embodiment of the present invention three;

Fig. 6 is source of sound and the microphone position schematic diagram of the embodiment of the present invention four;

Fig. 7 A is the The Cloud Terrace schematic diagram that is provided with microphone of the embodiment of the present invention five;

Fig. 7 B is the schematic diagram of the microphone pickup angle of the embodiment of the present invention five;

Fig. 7 C is the beam pattern drawing in polar coordinate system of the embodiment of the present invention five;

Fig. 8 A is source of sound and the microphone position schematic diagram of the embodiment of the present invention six;

Fig. 8 B is the beam pattern of the embodiment of the present invention six;

Fig. 9 is the beam pattern of ρ=0.2 o'clock in the embodiment of the present invention three;

Figure 10 is the beam pattern of ρ=0.7 o'clock in the embodiment of the present invention three;

Figure 11 is the microphone of the embodiment of the present invention and the schematic diagram that camera shares The Cloud Terrace;

Figure 12 is the composition schematic diagram of pickup control device embodiment mono-of the present invention;

Figure 13 is the composition schematic diagram of pickup control device embodiment bis-of the present invention;

Figure 14 is the composition schematic diagram of pickup control device embodiment tri-of the present invention;

Figure 15 is the composition schematic diagram of pickup control device embodiment tetra-of the present invention;

Figure 16 is the composition schematic diagram of pickup control device embodiment five of the present invention;

Figure 17 is the composition schematic diagram of control unit in pickup control device embodiment five of the present invention;

Figure 18 is the composition schematic diagram of pickup control device embodiment six of the present invention;

Figure 19 is the block diagram of an implementation of the present invention.

Embodiment

The embodiment of embodiment mono-, pick-up control method.The flow process of the method as shown in Figure 3.

In Fig. 3, the control signal of pickup Region control is carried out in S300, reception to pick up facility, by described control signal, make the pickup region of pick up facility be adjusted to target pickup region.

Optionally, the pick up facility here can include one or more microphones.The microphone here can be omnidirectional microphone or directional microphone, and a plurality of microphones can form microphone array.

Optionally, all microphones in microphone array, can be in the same plane, for example, all microphones form a plane polygon, and this polygon can be the regular polygon that the length of side is equal, and, in polygonal center, a microphone can be set.Optionally, pick up facility in the present embodiment can also arrange a microphone specially for background sound, background sound dedicated microphone can with pick up facility in other microphones be positioned at same plane, also can be positioned at different planes from other microphones in pick up facility.

Optionally, all microphones in pick up facility also can be positioned in Different Plane, a concrete example is: all microphones are with the distribution of shapes of many ribs vertebra, the summit of described polygonal pyramid is the position of microphone, and many ribs vertebra here can be: triangular pyramid, rectangular pyramid, pentagonal pyramid or more polygon pyramid etc.Optionally, the bottom of pyramid can be regular polygon, and the summit of rib vertebra can be positioned at perpendicular on regular polygon and the straight line through the center of regular polygon.

Optionally, the control signal of carrying out pickup Region control or adjusting of at least one microphone of above-mentioned reception can be the control signal receiving by network interface, control signal now can be the control signal based on far-end control protocol, and network interface can be the IP network interface based on packet switching, can be also based on Circuit-switched ISDN or E1 network interface etc.Wired (as Ethernet, xDSL, xPON) access way that the access way of network insertion can comprise and wireless (as WiFi, GSM, WiMAX) access way.

Optionally, the control signal of carrying out pickup Region control of above-mentioned reception can be also the control signal receiving by local control interface, if the control signal receiving is the control signal that remote controller sends, transmits by local control interface.Local control interface can be wireline interface (as RS232 etc.), can be also wave point (as infrared interface, blue tooth interface etc.).

Optionally, the content that the control signal in S300 comprises can have multiple different situation, and for example, this control signal includes the information that pickup is controlled that starts; Again for example, control signal is except including the information that starts pickup control, and adjustment step-length information, target pickup area information and the pickup control number of times that can also include pickup control duration, pickup control are isoparametric any one or more.Optionally, control signal can include and stops carrying out the information of pickup control or proceed information that pickup controls or the information in the target pickup region that activation prestores.Above-mentioned pickup is controlled duration and can be realized by timer,, before timer expiry, carries out follow-up S310 and/or S320; Work as timer expiry, stop the execution of S310 and/or S320.Optionally, the pickup region that the adjustment step-length information of utilizing above-mentioned pickup to control can produce target pickup region regulates parameter, but this target pickup region is not likely final target pickup region, and may be the interim target pickup region in a complete pickup control procedure.Optionally, above-mentioned pickup is controlled number of times and can be realized by counter,, before counter reaches predetermined count value, normally carries out follow-up S310 and/or S320; When counter reaches predetermined count value, stop the execution of follow-up S310 and/or S320.The content that control signal specifically comprises has detailed illustrating in subsequent embodiment.In addition, the agreement that control signal adopts and concrete form can arrange according to actual needs, and the present embodiment does not limit concrete agreement and the concrete form that control signal adopts.

S310, according to described control signal, determine that the pickup region in target pickup region regulates parameter.

The pickup region that the control signal that is about to receive is converted to target pickup region regulates parameter.

When this control signal includes the information that starts pickup control, the adjustment step-length information that can control based on pickup be determined target pickup region, for example, according to the current location of pick up facility microphone and adjustment step-length information, determines target pickup region.Now, can carry out the conversion process operation that pickup region regulates parameter according to adjusting step-length information.The adjustment step-length information that the pickup is here controlled can be the information of carrying in control signal, can be also the information that this locality sets in advance.

Optionally, in control signal, include when starting information that pickup controls and pickup and controlling duration, can regulate the conversion process of parameter to operate according to adjusting step-length information lasting pickup region of carrying out in pickup is controlled duration, until reach pickup, control duration, or until receive, include the control signal that stops pickup control information, thereby a plurality of pickups of the generation that can continue region regulates parameter.The adjustment step-length information that the pickup is here controlled can be the information of carrying in control signal, can be also the information that this locality sets in advance.

Optionally, in control signal, include when starting information that pickup controls and pickup and controlling number of times as n (n is greater than 0 integer), can carry out the conversion process operation that n time pickup region regulates parameter according to adjusting step-length information, thereby can produce n pickup region, regulate parameter.In pickup region, regulate the conversion process operation of parameter also not reach n time but receive and include the control signal that stops pickup control information, can no longer carry out follow-up conversion process and operate.The adjustment step-length information that the pickup is here controlled can be the information of carrying in control signal, can be also the information that this locality sets in advance.

Optionally, while including target pickup area information in control signal, can obtain according to the target pickup area information in this control signal pickup region and regulate parameter.

Optionally, in control signal, include the information that pickup is controlled that starts, but while not comprising the information such as pickup control duration, target pickup area information and pickup control number of times, can regulate the conversion process of parameter to operate according to adjusting the lasting pickup region of carrying out of step-length information, until receive, include the control signal that stops pickup control information.In addition, also can only carry out the conversion process operation that a time pickup region regulates parameter according to adjusting step-length information, rather than the conversion process operation of carrying out pickup region adjusting parameter continuing.The adjustment step-length information that the pickup is here controlled can be the information of carrying in control signal, can be also the information that this locality sets in advance.

Pickup region regulates parameter to have multiple different form according to the difference of adjusting pick up facility pickup domain mode.The content that regulates parameter to comprise to pickup region is below enumerated explanation.

Example 1, the synthetic method of employing signal regulate pick up facility pickup region: phase place and the amplitude of the audio signal that a plurality of microphones are picked up are processed, produce composite signal, pickup region regulates amplitude that parameter can comprise that each microphone is corresponding to adjust the weighted value of parameter and the corresponding phase place of the audio signal of picking up for each microphone is adjusted the delay parameter of parameter.Now in pick up facility, should be provided with a plurality of microphones.

Example 2, employing mechanical regulation method regulate pick up facility pickup region side: now the included microphone of pick up facility has respectively corresponding physics barrier structure, this physics barrier structure is used for the pickup angle of this microphone to regulate, by regulating the physical location (orientation) of microphone and/or regulating the physics of microphone pickup to block, the region of the audio signal that microphone picks up is changed.Now in pick up facility, can be provided with one or more microphones.

Example 3, adopt the synthetic and mechanical adjustment of signal in conjunction with regulating pick up facility pickup region: pickup orientation and pickup angle (scope) part are adjusted by above-mentioned signal synthesis method, and part adopts above-mentioned mechanical regulation method adjustment.As the The Cloud Terrace adjustment mechanically of pickup orientation, pickup angle is adjusted by the synthetic Beamforming Method of signal.

Example 4, by sound localization method, regulate pick up facility pickup region: utilize auditory localization algorithm to determine whether sound source is positioned at the pickup region of setting, if sound source is positioned at the pickup region of setting, control microphone pickup output audio signal, if sound source is positioned at outside pickup region, even if control microphone, do not carry out the pickup of audio signal or pick up this audio signal, but above-mentioned audio signal not exported.Auditory localization can adopt TDOA (Time Difference of Arrivals, arrive time delay) technology, this technology adopts the different microphone in a plurality of positions, obtain the time delay that sound arrives diverse location microphone, try to achieve the range difference that sound arrives diverse location microphone utilizing these time delays, finally with geometrical relationship or search, determine sound source position, this method is to be widely used a kind of in auditory localization technology, specific implementation repeats no more, be appreciated that, those of ordinary skill in the art is by instruction and the inspiration of TDOA technology, it will also be appreciated that other auditory localization algorithm, to this, embodiments of the invention do not limit.

Above-mentionedly enumerate 4 and regulate the example of pick up facility pickup domain modes to apply separately, also can applied in any combination, corresponding, above-mentionedly enumerate 4 pickup regions and regulate parameters to comprise that the example of parameter information can apply separately, also can applied in any combination.

The difference that regulates parameter to comprise parameter information due to pickup region, the specific implementation process that control signal is converted to the pickup region adjusting parameter in target pickup region also can be different, concrete transfer process has detailed example to record in the following embodiments, at this, no longer describes in detail.No matter conversion process is specific implementation how, it should be that pickup region corresponding to target pickup region regulates parameter that pickup region after conversion regulates parameter, and conversion principle is: the pickup region after conversion regulates parameter should make the target pickup region corresponding with control signal, pickup region of pick up facility substantially conform to.

S320, according to described pickup region, regulate parameter to carry out pickup control at least one microphone in described pick up facility, thereby the pickup region corresponding to audio signal of pick up facility output conformed to target pickup region.

Carry out after pickup control, pick up facility carries out pickup for target pickup region.

First concrete example that the pickup of S320 is controlled is: according to the pickup region in target pickup region, regulate phase place and the amplitude of the audio signal that weighted value in parameter and delay parameter pick up and export each microphone in pick up facility to adjust, do not belong to the audio signal in target pickup region with filtering.

It should be noted that, above-mentioned utilize amplitude adjustment parameter and phase place are adjusted the adjustment that parameter is carried out microphone, can carry out for the single microphone of pick up facility, also can carry out for a plurality of microphones of pick up facility.Wherein, single microphone for pick up facility is controlled, by weighted value, adjust the amplitude of the audio signal of picking up of this microphone, by delay parameter, adjust the phase place of the audio signal that this microphone picks up, the audio signal that this microphone after adjusting is collected is synthesized and is obtained the audio signal that final pick up facility is exported with the signal of other microphone collections; When above-mentioned control signal is that a plurality of microphones for pick up facility carry out pickup while controlling, the amplitude of the audio signal that the corresponding weighted value by microphone to be adjusted picks up described microphone to be adjusted is adjusted, the phase place of the audio signal of described microphone to be adjusted being picked up by delay parameter corresponding to microphone to be adjusted is adjusted, and the audio signal of each microphone after above-mentioned adjustment is synthesized to the audio signal that obtains final pick up facility output.

It should be noted that, microphone is carried out to audio signal to carry out after amplitude and/or phase place adjustment, need to the signal that in pick up facility, each microphone picks up be synthesized, it has been prior art that each microphone is carried out to signal synthetic technology, at this, no longer repeats.

Second concrete example that the pickup of S320 is controlled is: according to shift position parameter adjustment microphone shelter corresponding to the microphone pickup angle in the pickup region adjusting parameter in target pickup region and the relative position of microphone, as the position of mobile shelter, for another example the position of mobile microphone, also has the position of mobile shelter and microphone.

The 3rd the concrete example that the pickup of S320 is controlled is: according to the pickup region in target pickup region, regulate the position adjustments parameter of the microphone place The Cloud Terrace in parameter to carry out the adjustment of level and/or pitch position to microphone place The Cloud Terrace.

The 4th the concrete example that the pickup of S320 is controlled is: according to the pickup region in target pickup region, regulate the parameter of the whether pickup in parameter to judge that the parameter of the whether pickup that each microphone is corresponding is that pickup is also non-pickup, if a parameter corresponding to microphone is pickup, control this microphone and pick up audio signal output, can obtain the audio signal that this microphone picks up; If a parameter corresponding to microphone is non-pickup, can controls this microphone and not pick up audio signal, or not accept the audio signal that this microphone picks up.

Above-mentioned four object lessons of enumerating in S320 can be applied separately, also can combination in any application.

It should be noted that, in above-described embodiment one, the execution flow process of S310 and S320 can be: produce a pickup region and regulate parameter, carry out a pickup and control, then, then produce a pickup region adjusting parameter, then carry out a pickup and control.The execution flow process of S310 and S320 can be also: after producing a plurality of pickups region adjusting parameter, regulate the generation order of parameter to carry out successively pickup again according to pickup region and control, in this execution flow process, if received, stop the control signal that pickup is controlled, even if also have one or more pickup regions that produced but also do not had to apply, regulate parameter, also no longer carry out S320.

Optionally, after having carried out S320, can comprise: the gain of the audio signal after synthetic to each microphone is adjusted.Described gain increases along with the reducing of pickup angle of described pick up facility.To the gain adjustment of audio signal, can adopt existing gain to adjust implementation, the present embodiment specific implementation process that limiting gain is not adjusted.

In addition, optionally, after having carried out S320, can also comprise: to control terminal, return to the current pickup area information of pick up facility after pickup is controlled, this current pickup area information can represent with the form of beam pattern, also can represent with forms such as orientation angles and pickup angle numerical value.A concrete example is: regulate in the application scenarios of parameter continue producing a plurality of pickups region, often according to a pickup region, regulate parameter to carry out, after pickup control, all to control terminal, returning to corresponding beam pattern.The control terminal here can be the network equipment being connected with pick up facility by network interface, can be also the network equipment being connected with pick up facility by local interface.The control terminal here can be for sending the network equipment of P/T/Z (Pan/Tilt/Zoom, comprehensive (comprising: upper and lower, left and right), movement and front and back were controlled) control signal.

Description from above-described embodiment one, the pick-up control method of embodiment mono-can be realized the pickup of the microphone in pick up facility is controlled by PTZ control signal and to the conversion process of PTZ control signal, because PTZ control signal can be transmitted by network interface and local control interface, therefore, embodiment mono-can realize the far-end of pickup and control, and is applicable to being applied in the application scenarioss such as video conference.By adopting the relative position of weighted value, microphone and shelter, the various ways such as the adjustment of the horizontal and vertical position of The Cloud Terrace and whether pickup carry out pickup control to microphone, not only can realize the pickup of horizontal direction, vertical direction and angle controls, make the pickup control mode of pick up facility more flexible, and can carry out careful accurate control to the pickup of microphone.In addition, the pick-up control method of embodiment mono-can well be applicable in multichannel or monaural pick up facility.

Several concrete implementation procedures of take are below illustrated pick-up control method of the present invention as example.Because following each embodiment all has the emphasis of description, therefore, following each embodiment is applied in any combination optionally.Specific implementation process for a lot of applied in any combination no longer describes in detail.

Embodiment bis-, based on the synthetic mode of signal, carry out pick-up control method.The principle of the pick-up control method of the forming method generation of employing fixed beam output audio signal as shown in Figure 4.

In Fig. 4, pick up facility is provided with m microphone, and m microphone output m road audio signal, omits and show the 3rd Zhi m-1 road, road audio signal in Fig. 4.The audio signal Y (t) of pick up facility output can be expressed as form:

$Y\left(t\right)=\underset{i=1}{\overset{m}{\mathrm{\Σ}}}{w}_i\×X_i(t-{\mathrm{\τ}}_i)$ Formula (1)

Wherein, X _ibe the audio signal that i road microphone picks up, or perhaps the i road input signal of pick up facility, Y is the audio signal of pick up facility output, w _ibe the weighted value distributing for i road audio signal, m is the number of microphone in pick up facility, τ _ithat parameter is adjusted in the delay arranging for i road microphone.

Pickup control procedure for Fig. 4 can be: receive PTZ control signal, PTZ control signal is converted to above-mentioned weighted value w _iwith delay parameter τ _i, then, according to the weighted value w after conversion _iwith delay parameter τ _iutilize formula (1) to producing composite signal, thereby obtain the audio signal output conforming to target pickup region.The above-mentioned PTZ control signal receiving can include the adjusting information of horizontal direction, the adjusting information of pitch orientation and pickup angular adjustment information etc.PTZ control signal is converted to weighted value w _iwith delay parameter τ _ispecific implementation process have in the following embodiments detailed illustrating.

The pick-up control method of the adjusting step-length that embodiment tri-, the employing based on weighted value pre-set.In the situation that the pickup that the microphone of pick up facility is carried out is controlled as microphone being carried out to Z (zoom), regulate, the flow process of the method is as shown in accompanying drawing 5A.

In Fig. 5 A, S500, receive and start Zoom regulating command,

By network interface or local control interface, receive and include the PTZ control signal of carrying out ZOOM adjusting.PTZ control signal is now called startup ZOOM regulating command.Optionally, after receiving startup ZOOM regulating command, can start timer for ZOOM regulating command, the timing length of this timer can obtain from start ZOOM regulating command, also can from the pre-stored information in this locality, obtain, as adopt default timing length.

S510, according to the current pickup angle Z of pick up facility microphone and the ZOOM that pre-sets, regulate step delta Z to calculate the pickup angle that microphone need to be adjusted to.The pickup angle that microphone need to be adjusted to is pickup angle corresponding to target pickup region.The pickup angle that microphone need to be adjusted to is 2 φ, and 2 φ=Z ± Δ Z.

S520, based on φ, calculate the weighted value w of each microphone in pick up facility _i, for example, utilize φ and other calculation of parameter to go out the weighted value w of each microphone in pick up facility _i, other parameters here can be array microphone geometric parameter, thresholding ρ and some other constraints (specifically referring to embodiment) etc.

S530, use w _iaudio signal to each microphone output of pick up facility is processed, the audio signal that pick up facility output is conformed to the target pickup region of recording in above-mentioned S510.

S540, the current pickup angle Z of pick up facility microphone is adjusted into 2 φ.

S550, judge whether to receive and include the PTZ control signal that stops pickup control information by network interface or local control interface, including the PTZ control signal that stops pickup control information can be called and stop ZOOM regulating command, if received, stop ZOOM regulating command, arrive S560, otherwise, to S510, continue to carry out the adjusting of pickup angle for microphone.

Optionally, if started timer in S500, in S550, also should judge that whether timer is overtime, no matter receive and stop ZOOM regulating command or timer expiry, equal required S560.

Optionally, after S530 or S540 or S550 or S560, can also comprise: to control terminal, return to the beam pattern information of carrying out after ZOOM adjusting, like this, control terminal can know that following ZOOM regulates the beam pattern changing, thereby control terminal can judge whether realized its pickup control needing according to the beam pattern returning, after judging pickup control that has realized its needs, control terminal can send and stop ZOOM regulating command.Certainly, above-mentioned beam pattern information also can replace with the forms such as ZOOM numerical value.

S560, termination regulate for the ZOOM of microphone.

In embodiment tri-, pick up facility can be provided with one or more microphones.As an example, the in the situation that of being provided with 5 microphones in pick up facility, the distribution of these 5 microphones can be as shown in accompanying drawing 5B.The distribution of the microphone 1 in Fig. 5 B, microphone 3, microphone 4 and microphone 5 is square, and microphone 2 is positioned at foursquare center, and the arranged outside of 5 microphones has shelter--sleeve.Sleeve can move along the normal direction of 5 microphone place planes.Although sleeve has been shown in Fig. 5 B, but the flow process shown in Fig. 5 A is not adjusted the relative position of microphone and sleeve, if need to adjust the relative position of microphone and sleeve, the S520 in above-mentioned Fig. 5 A and S530 can replace with the relative position of adjusting microphone and sleeve, for example, sleeve moves along the normal direction of microphone place plane, because sleeve, to the scope of blocking in microphone pickup region, change has occurred, therefore, the pickup angle of microphone also can change thereupon.It is also same that microphone is moved.

Above-described embodiment three is adjusted to example with Z and describes, P (level, i.e. left and right) regulate and the specific implementation process of specific implementation process that T (pitching, also vertical up and down) regulates and above-mentioned Z adjusting basic identical, above-described embodiment is that to regulate be with to weight w in addition _iadjusting describe, to the adjusting of delay, The Cloud Terrace etc., be also similar process, in embodiment tri-, no longer describe in detail.

Embodiment tetra-, the pick-up control method based on weighted value.The present embodiment is described according to PTZ control signal and is determined that the pickup region in target pickup region regulates the specific implementation process of parameter in connection with the microphone distribution situation emphasis shown in accompanying drawing 5B.

The PTZ control signal that setting receives is the PTZ control signal of carrying out respectively pickup control for the P of microphone and T.

To simplify the analysis, respectively horizontal and vertical direction is calculated, when the P for pick up facility carries out pickup control, be reduced to a linear microphone array, adopt plane wave model, as shown in Figure 6, target source of sound and center microphone are that the line of microphone 2 and the angle of microphone array normal direction are θ, if the initial position that normal direction is former source of sound, θ is the P deflection angle that microphone need to carry out pickup control.

Set sound wave (the being audio signal) X that microphone i (i=1,2,3) receives _i(t) by complex exponential form, be expressed as:

X _i(t)=e ^{j ω (t-(i-1) d sin θ/c)}=e ^{j[ω t-2 π (i-1) d/ λ]}formula (2)

Wherein, the angular speed that ω is sound wave, the wavelength that λ is sound wave, c is sound wave transmission speed, and d is array element distance (distance between microphone), and amplitude is equivalent to 1.T is the time.

Setting situation under, above-mentioned formula (2) can be changed to:

X _i(t)=e ^{j[ω t-(i-1) α]}formula (3)

Now, the audio signal of pick up facility output is that composite signal is:

$Y\left(t\right)=\underset{i=1}{\overset{3}{\mathrm{\Σ}}}{w}_i\×X_i\left(t\right)\×e^{-\mathrm{j\ω}{\mathrm{\τ}}_i}$

$=\underset{i=1}{\overset{3}{\mathrm{\Σ}}}{w}_i{e}^{\mathrm{j\ωt}}{e}^{-j[(i-1)\mathrm{\α}+\mathrm{\ω}{\mathrm{\τ}}_i]}$

$=w_1{e}^{-\mathrm{j\ω}{\mathrm{\τ}}_1}{e}^{\mathrm{j\ωt}}+w_2{e}^{-j(\mathrm{\α}+\mathrm{\ω}{\mathrm{\τ}}_2)}{e}^{\mathrm{j\ωt}}+w_3{e}^{-j(2\mathrm{\α}+\mathrm{\ω}{\mathrm{\τ}}_3)}{e}^{\mathrm{j\ωt}}$ Formula (4)

In order to make composite signal maximum along θ angular direction (amplitude of composite signal is maximum), need to make when i gets different numerical value, all equate, meanwhile, when the pickup of carrying out vertical direction for microphone is controlled, affect microphone 2, need to be by delay parameter τ ₂be set to 0, therefore can obtain:

$\left\{\begin{array}{c}\mathrm{\ω}{\mathrm{\τ}}_1=2\mathrm{k\π}+\mathrm{\α}\\ {\mathrm{\τ}}_2=0\\ 2\mathrm{\α}+\mathrm{\ω}{\mathrm{\τ}}_3=2\mathrm{n\π}+\mathrm{\α}\end{array}\right.$ Formula (5)

Wherein, k and n are arbitrary integer.

If set k=n=0, can obtain one group of design of each pick up facility delay parameter:

$\left[\begin{array}{c}{\mathrm{\τ}}_1\\ {\mathrm{\τ}}_2\\ {\mathrm{\τ}}_3\end{array}\right]=\left[\begin{array}{c}d\sin \mathrm{\θ}/c\\ 0\\ -d\sin \mathrm{\θ}/c\end{array}\right]$ (6)

Similarly, after pitching (T) the pickup angle of adjustment pick up facility is η, can obtain:

$\left[\begin{array}{c}{\mathrm{\τ}}_4\\ {\mathrm{\τ}}_2\\ {\mathrm{\τ}}_5\end{array}\right]=\left[\begin{array}{c}d\sin \mathrm{\η}/c\\ 0\\ -d\sin \mathrm{\η}/c\end{array}\right]$ Formula (7)

Wherein, d can design according to actual restraint condition, and for example, according to actual bulk restrictive condition design d, the value of d can be 0.2m.

In this example, only need to just control and can regulate pickup direction, w by delay _ican design according to actual conditions, for example, w _ivalue can be 1/m, wherein, the quantity that m is microphone, the in the situation that of 5 microphones, w _ican be 1/5.

From the description of above-described embodiment four, horizontally rotate accordingly after the PTZ control signal with pitch regulation receiving with θ and η, the method for recording according to above-described embodiment four obtains delay parameter τ corresponding to each microphone after the conversion of PTZ control signal ₁～τ ₅and weighted value w _i(value of i is 1 to 5), afterwards, utilizes τ ₁～τ ₅and w _ithe audio signal that each microphone is picked up is processed, and can obtain the audio signal substantially conforming to the pickup region of expecting (target pickup region).

Embodiment five, utilize mechanical rotation control mechanism to carry out pitching and/or horizontally rotate and the mode of weighted value realizes the method that pickup is controlled.In the present embodiment, take The Cloud Terrace describes pick-up control method as mechanical rotation control mechanism as example.

On The Cloud Terrace shown in Fig. 7 A, be provided with 5 microphones, The Cloud Terrace can carry out by the control of stepping motor the movement of horizontal and vertical direction, and then has changed the pickup orientation of microphone.

In embodiment five, the pickup angle of microphone also can be adjusted, and for example, picks up delay parameter and the weighted value of audio signal the pickup angle of microphone is adjusted by controlling microphone; The gain of the audio signal of more for example, picking up by control microphone is adjusted the pickup angle of microphone.Mainly the adjustment of microphone pickup angle (ZOOM) is elaborated below.

Pickup for the horizontal direction of the ZOOM of microphone is controlled as follows:

Because The Cloud Terrace can rotate, therefore, the azimuthal adjustment of microphone can realize by The Cloud Terrace, and therefore for array microphone, can be considered as θ is 0, therefore, and the phase delay parameter τ of microphone _i=0, for become the sound wave of arbitrarily angled δ with normal, its composite signal is:

$Y\left(t\right)=\underset{i=1}{\overset{3}{\mathrm{\Σ}}}{w}_i{e}^{\mathrm{j\ωt}}{e}^{-j\left[(i-1)\mathrm{\α}\left(\mathrm{\δ}\right)\right]}$

${=w}_1{e}^{\mathrm{j\ωt}}+w_2{e}^{-\mathrm{j\α}\left(\mathrm{\δ}\right)}{e}^{\mathrm{j\ωt}}+w_3{e}^{-j\left(2\mathrm{\α}\left(\mathrm{\δ}\right)\right)}{e}^{\mathrm{j\ω}}$

$=(w_1{e}^{\mathrm{j\α}\left(\mathrm{\δ}\right)}+w_2+w_3{e}^{-\mathrm{j\α}\left(\mathrm{\δ}\right)})e^{-\mathrm{j\α}\left(\mathrm{\δ}\right)}{e}^{\mathrm{j\ωt}}$ Formula (8)

The Amplitude-squared of composite signal is:

${\left|Y\left(t\right)\right|}^2={\left|(w_1{e}^{\mathrm{j\α}\left(\mathrm{\δ}\right)}+w_2+w_3{e}^{-\mathrm{j\α}\left(\mathrm{\δ}\right)})e^{-\mathrm{j\α}\left(\mathrm{\δ}\right)}{e}^{\mathrm{j\ωt}}\right|}^2$

$=[w_1\cos \left(\mathrm{\α}\left(\mathrm{\δ}\right)\right)+w_2+w_3\cos (-\mathrm{\α}\left(\mathrm{\δ}\right)){]}^2+[w_1\sin \left(\mathrm{\α}\left(\mathrm{\δ}\right)\right)+w_3\sin (-\left(\mathrm{\α}\left(\mathrm{\δ}\right)\right)){]}^2$

$={[(w_1+w_3)\cos \left(\mathrm{\α}\left(\mathrm{\δ}\right)\right)+w_2]}^2+[(w_1-w_3)\sin \left(\mathrm{\α}\left(\mathrm{\δ}\right)\right){]}^2$

$={[(w_1+w_3)\cos \left(\frac{2\mathrm{\πd}}{\mathrm{\λ}}\left(\sin \left(\mathrm{\δ}\right)\right)\right)+w_2]}^2+[(w_1-w_3)\sin \left(\frac{2\mathrm{\πd}}{\mathrm{\λ}}\left(\sin \left(\mathrm{\δ}\right)\right)\right){]}^2$ Formula (9)

For simplified design, can make w ₁=w ₃, have

$\left|Y\left(t\right)\right|=|2w_1\cos \left(\frac{2\mathrm{\πd}}{\mathrm{\λ}}\left(\sin \left(\mathrm{\δ}\right)\right)\right)+w_2|=|2w_{1}f\left(\mathrm{\δ}\right)+w_2|,$ Wherein $f\left(\mathrm{\δ}\right)=\cos \left(\frac{2\mathrm{\πd}}{\mathrm{\λ}}\sin \left(\mathrm{\δ}\right)\right)$ Formula (10)

While carrying out ZOOM adjusting, as shown in accompanying drawing 7B, the pickup angle that is equivalent to pick up facility adjustment is 2 φ, (border when sound source is positioned at pickup angle φ orientation, be two rays that represent with solid line in Fig. 7 B), the amplitude fading of composite signal is to ρ (0 < ρ < 1) times of normal direction (δ=0) amplitude, that is:

formula (11)

(1) in use formula (11) can obtain:

$\frac{w_2}{w_1}=\frac{2(\mathrm{\&rho;}-f\left(\mathrm{\&phi;}\right))}{1-\mathrm{\&rho;}}$ ... ... ... .... as (2w ₁f (φ)+w ₂) > 0 formula (12)

Set w ₁and w ₂be greater than 0, (1) in formula (11) can obtain

F (φ) < ρ ... ... ... .... as (2w ₁f (φ)+w ₂) > 0 formula (13)

For δ is existed in scope during value, | Y (t) | can monotone variation, need to make reindexing not in respective bins, thus have

The span that convolution (13) can obtain φ is constrained to:

$\arccos \left(\mathrm{\&rho;}\right)\&le;\frac{2\mathrm{\&pi;d}}{\mathrm{\&lambda;}}\sin \left(\mathrm{\&phi;}\right)\&le;\mathrm{\&pi;}$ Formula (14)

The maximum of setting φ is φ _max, minimum value is φ _min, have:

$\left\{\begin{array}{c}\frac{d}{\mathrm{\&lambda;}}\&le;\frac{1}{2\sin \left({\mathrm{\&phi;}}_{\max }\right)}\\ {\mathrm{\&phi;}}_{\min }\&GreaterEqual;\arcsin \left(\frac{\arccos \left(\mathrm{\&rho;}\right)\&times;\mathrm{\&lambda;}}{2\mathrm{\&pi;d}}\right),\frac{d}{\mathrm{\&lambda;}}\&GreaterEqual;\frac{\arccos \left(\mathrm{\&rho;}\right)}{2\mathrm{\&pi;}}\end{array}\right.$ Formula (15)

Due in arrowband situation, λ is known, therefore, can determine the parameter of array microphone engineering for the ease of array microphone is made the span that can obtain larger φ, and d can select higher value, for example certainly, d also can select to meet other values of condition.

If to w _ifurther impose restriction, can obtain w _i.The concrete example imposing restriction is: condition ∑ w is set _i=C.

Known by as above describing, one group of design of the relevant parameter of the microphone in pick up facility can be expressed as form:

formula (16)

As ∑ w _iduring=C, have

formula (17)

When $d=\frac{\mathrm{\&lambda;}}{2\sin {\mathrm{\&phi;}}_{\max }}$ Time, have

formula (18)

A concrete design example of the relevant parameter of the microphone in pick up facility below:

Set c=1, λ=0.1m, the relevant parameter of the microphone in pick up facility is:

formula (19)

The composite signal of pick up facility output is:

$\left|Y\left(t\right)\right|=2w_1\cos \left(\frac{2\mathrm{\&pi;d}}{\mathrm{\&lambda;}}\sin \left(\mathrm{\&delta;}\right)\right)w_2=0.272\cos \left(3.63\sin \mathrm{\&delta;}\right)+0.728.$ Formula (20)

If with for polar angle, take | Y (t) | be utmost point footpath, the beam pattern drawing in polar coordinate system can be as shown in accompanying drawing 7C.

From the beam pattern shown in Fig. 7 C, can find out, at 180 degree, to 360 degree (back side that is equivalent to pick up facility), also can pick up audio signal, in actual applications can be by blocking the back side of pick up facility or the back side of hypothesis pick up facility does not have source of sound to avoid the impact of the audio signal of picking up from the back side.

If control to adopt for the pickup of the vertical direction of the ZOOM of microphone, control similar mode design with the pickup of the horizontal direction of ZOOM for microphone, one of the relevant parameter of the microphone in pick up facility group of design can be:

$\left\{\begin{array}{c}{\mathrm{\&tau;}}_i=0\\ d=\frac{\mathrm{\&lambda;}}{2\sin {\mathrm{\&phi;}}_{\max }}\\ w_4=\frac{C(1-\mathrm{\&rho;})}{2[1-f\left(\mathrm{\&phi;}\right)]}\\ w_2=\frac{C[\mathrm{\&rho;}-f\left(\mathrm{\&phi;}\right)]}{1-f\left(\mathrm{\&phi;}\right)}\\ w_5=\frac{C(1-\mathrm{\&rho;})}{2[1-f\left(\mathrm{\&phi;}\right)]}\end{array}\right.$ Formula (21)

In embodiment five, because P and T adjust by The Cloud Terrace, and ZOOM adjusts by weighted value, therefore, after receiving PTZ control signal, PTZ control signal should be converted to PT regulating command and Z regulating command, with PT regulating command, control the movement of The Cloud Terrace, with Z regulating command, control the ZOOM of microphone.PT regulating command regulates predetermined step-length, pitching to regulate predetermined step-length and pitching upwards to regulate predetermined step-length etc. downwards to the right as level regulates predetermined step-length, level left.The pickup region that above-mentioned PT regulating command and Z regulating command all belong to target pickup region regulates parameter.

For the pick up facility that more multi-microphone (m=2k+1) forms, can be easy to set up more general equation and solve:

Be provided with m=2k+1 microphone, be respectively-k of numbering i ... 0 ... k, wherein the 0th is middle microphone, between microphone, spacing is d

$\left\{\begin{array}{c}\left|Y\left(\mathrm{\&phi;}\right)\right|=\left|\underset{i=-k}{\overset{k}{\mathrm{\&Sigma;}}}{w}_i{e}^{-j\left[(i-1)\mathrm{\&alpha;}\left(\mathrm{\&phi;}\right)\right]}\right|\\ \left|Y\left(\mathrm{\&phi;}\right)\right|=\mathrm{\&rho;}\underset{i=-k}{\overset{k}{\mathrm{\&Sigma;}}}{w}_i\end{array}\right.$ Formula (22)

For above formula, can according to circumstances increase various constraint solvings, provide a kind of method for solving below:

Make w _i=w _-ican obtain:

$\left|Y\left(\mathrm{\&phi;}\right)\right|=|2\underset{i=1}{\overset{k}{\mathrm{\&Sigma;}}}\left(w_i\cos \left(i\frac{2\mathrm{\&pi;d}}{\mathrm{\&lambda;}}\left(\sin \left(\mathrm{\&phi;}\right)\right)\right)\right)+w_0|=\left|2\underset{i=1}{\overset{k}{\mathrm{\&Sigma;}}}\left(w_i{f}_i\left(\mathrm{\&phi;}\right)w_0\right)\right|,$ Wherein $f_i\left(\mathrm{\&phi;}\right)=\cos \left(i\frac{2\mathrm{\&pi;d}}{\mathrm{\&lambda;}}\sin \left(\mathrm{\&phi;}\right)\right)$ Formula (23)

Order $\left\{\begin{array}{c}{w}_i=w_1,i=1...k\\ \underset{i=-k}{\overset{k}{\mathrm{\&Sigma;}}}{w}_i=C\end{array}\right.$

Reference is solving of 3 microphones above, can solve:

$\left\{\begin{array}{c}{w}_0=\frac{C(\mathrm{k\&rho;}-F\left(\mathrm{\&phi;}\right))}{k-F\left(\mathrm{\&phi;}\right)}\\ w_i=\frac{C(1-\mathrm{\&rho;})}{2(k-F\left(\mathrm{\&phi;}\right))},i\&NotEqual;0\end{array}\right.,$ Wherein $F\left(\mathrm{\&phi;}\right)=\underset{i=1}{\overset{k}{\mathrm{\&Sigma;}}}\cos \left(i\frac{2\mathrm{\&pi;d}}{\mathrm{\&lambda;}}\sin \left(\mathrm{\&phi;}\right)\right)$

Formula (24)

Similarly can try to achieve a conservative span

$d\&le;\frac{\mathrm{\&lambda;}}{2k\sin {\mathrm{\&phi;}}_{\max }}$ Formula (25)

Embodiment six, complete in the synthetic pick-up control method of signal.

In embodiment six, not at grade, the distribution shape of a plurality of microphones is rib vertebra shape to a plurality of microphones that pick up facility comprises.A concrete distribution example is: microphone in 5 microphones shown in Fig. 5 B 2 is not with other four microphones in same plane, and now, can forming one, to take microphone 1,3,4 and 5 be bottom surface, the four rib vertebras that the microphone 2 of take is summit.Before microphone 2 is protruded to the plane at other microphone places, microphone 1,2 and 3 and the position relationship of source of sound as shown in accompanying drawing 8A.

In Fig. 8 A, microphone 1,2 and 3 forms an equilateral triangle, and θ is the angle between source of sound and horizontal line, rather than the angle between source of sound and normal, and corresponding, pickup level (P) the direction deflection angle of adjusting is

Below in conjunction with accompanying drawing 8A, the pickup of horizontal direction is controlled and described.

The composite signal of pick up facility can be expressed as:

$Y\left(t\right)=\underset{i=1}{\overset{3}{\mathrm{\&Sigma;}}}{w}_i\&times;X_i\left(t\right)\&times;e^{-\mathrm{j\&omega;}{\mathrm{\&tau;}}_i}$

$=w_1{e}^{-j(\mathrm{\&omega;}{\mathrm{\&tau;}}_1+\frac{2\mathrm{\&pi;d}}{\mathrm{\&lambda;}}\cos (\frac{\mathrm{\&pi;}}{3}-\mathrm{\&theta;}))}{e}^{\mathrm{j\&omega;t}}{+w}_2{e}^{-\mathrm{j\&omega;}{\mathrm{\&tau;}}_2}{e}^{\mathrm{j\&omega;t}}+w_3{e}^{-j(\mathrm{\&omega;}{\mathrm{\&tau;}}_3+\frac{2\mathrm{\&pi;d}}{\mathrm{\&lambda;}}\cos (\frac{2\mathrm{\&pi;}}{3}-\mathrm{\&theta;}))}{e}^{\mathrm{j\&omega;t}}$ Formula (26)

In order to make composite signal maximum along θ angular direction,, in order to make composite signal maximum along the amplitude of θ angular direction, need to make the phase place of composite signal identical, wherein one group of solution of formula (26) is:

$\left\{\begin{array}{c}\mathrm{\&omega;}({\mathrm{\&tau;}}_1+\frac{2\mathrm{\&pi;d}}{\mathrm{\&lambda;}}\cos (\frac{\mathrm{\&pi;}}{3}-\mathrm{\&theta;}))=0\\ \mathrm{\&omega;}{\mathrm{\&tau;}}_2=0\\ \mathrm{\&omega;}({\mathrm{\&tau;}}_3+\frac{2\mathrm{\&pi;d}}{\mathrm{\&lambda;}}\cos (\frac{2\mathrm{\&pi;}}{3}-\mathrm{\&theta;}))=0\end{array}\right.\&DoubleRightArrow;\left\{\begin{array}{c}{\mathrm{\&tau;}}_1=-\frac{2\mathrm{\&pi;d}}{\mathrm{\&lambda;}}\cos (\frac{\mathrm{\&pi;}}{3}-\mathrm{\&theta;})\\ {\mathrm{\&tau;}}_2=0\\ {\mathrm{\&tau;}}_3=-\frac{2\mathrm{\&pi;d}}{\mathrm{\&lambda;}}\cos (\frac{2\mathrm{\&pi;}}{3}-\mathrm{\&theta;})\end{array}\right.$ Formula (27)

In order to make τ _i>=0, increase a unified retardation can to all delayers, or increase one-period to some delayer (being certain delay parameter) do not affect the composite signal of output.

Control similarly with the pickup of horizontal direction, after the pickup angle of adjusting pitching (T) is η, can obtain:

$\left\{\begin{array}{c}{\mathrm{\&tau;}}_4=-\frac{2\mathrm{\&pi;d}}{\mathrm{\&lambda;}}\cos (\frac{\mathrm{\&pi;}}{3}-\mathrm{\&eta;})\\ {\mathrm{\&tau;}}_2=0\\ {\mathrm{\&tau;}}_5=-\frac{2\mathrm{\&pi;d}}{\mathrm{\&lambda;}}\cos (\frac{2\mathrm{\&pi;}}{3}-\mathrm{\&eta;})\end{array}\right.$ Formula (28)

According to ZOOM, regulate and determine weight parameter ^wprocess be:

For become the sound wave at (δ-θ) angle with θ direction, the composite signal of pick up facility can be expressed as:

$Y\left(t\right)=\underset{i=1}{\overset{3}{\mathrm{\&Sigma;}}}{w}_i\&times;X_i\left(t\right)\&times;e^{-\mathrm{j\&omega;}{\mathrm{\&tau;}}_i}$

$=w_1{e}^{-j\frac{2\mathrm{\&pi;d}}{\mathrm{\&lambda;}}\cos (\frac{\mathrm{\&pi;}}{3}-\mathrm{\&delta;})}{e}^{\mathrm{j\&omega;t}}{e}^{j\frac{2\mathrm{\&pi;d}}{\mathrm{\&lambda;}}\cos (\frac{\mathrm{\&pi;}}{3}-\mathrm{\&theta;})}+w_2{e}^{\mathrm{j\&omega;t}}+w_3{e}^{-j\frac{2\mathrm{\&pi;d}}{\mathrm{\&lambda;}}\cos (\frac{2\mathrm{\&pi;}}{3}-\mathrm{\&delta;})}{e}^{\mathrm{j\&omega;t}}{e}^{j\frac{2\mathrm{\&pi;d}}{\mathrm{\&lambda;}}\cos (\frac{2\mathrm{\&pi;}}{3}-\mathrm{\&theta;})}$

$=|w_1{e}^{-j\frac{2\mathrm{\&pi;d}}{\mathrm{\&lambda;}}\cos (\frac{\mathrm{\&pi;}}{3}-\mathrm{\&delta;})}{e}^{j\frac{2\mathrm{\&pi;d}}{\mathrm{\&lambda;}}\cos (\frac{\mathrm{\&pi;}}{3}-\mathrm{\&theta;})}+w_2+w_3{e}^{-j\frac{2\mathrm{\&pi;d}}{\mathrm{\&lambda;}}\cos (\frac{2\mathrm{\&pi;}}{3}-\mathrm{\&delta;})}{e}^{j\frac{2\mathrm{\&pi;d}}{\mathrm{\&lambda;}}\cos (\frac{2\mathrm{\&pi;}}{3}-\mathrm{\&theta;})}|$

$=|w_1{e}^{j\frac{2\mathrm{\&pi;d}}{\mathrm{\&lambda;}}(\cos (\frac{\mathrm{\&pi;}}{3}-\mathrm{\&theta;})-\cos (\frac{\mathrm{\&pi;}}{3}-\mathrm{\&delta;}))}+w_2+w_3{e}^{j\frac{2\mathrm{\&pi;d}}{\mathrm{\&lambda;}}(\cos (\frac{2\mathrm{\&pi;}}{3}-\mathrm{\&theta;})-\cos (\frac{2\mathrm{\&pi;}}{3}-\mathrm{\&delta;}))}|$ Formula (29)

Known according to formula (29), for given pickup orientation θ and pickup angular range 2 φ, set when sound source is positioned at pickup angle φ orientation (δ=θ ± φ), the amplitude fading of composite signal is to ρ (0 < ρ < 1) times of normal direction (δ=θ) amplitude, that is:

| Y (θ ± φ) |=ρ | Y (θ) |=α (w ₁+ w ₂+ w ₃) ... .... (5) formula (30)

Utilize (5) in formula (30) can solve w _i, solving result is not unique, can solve by increasing some constraintss again, this constraints is as ∑ w _i=C etc.

At w _iin the situation of > 0, set c=1, can obtain:

$\left\{\begin{array}{c}|w_1{e}^{j2\mathrm{\&pi;}(\cos \left(\frac{\mathrm{\&pi;}}{12}\right)-\cos (-\frac{\mathrm{\&pi;}}{12}))}+w_2+w_3{e}^{j2\mathrm{\&pi;}(\cos \left(\frac{5\mathrm{\&pi;}}{12}\right)-\cos \left(\frac{\mathrm{\&pi;}}{4}\right))}|=\frac{1}{2}(w_1+w_2+w_3)\\ |w_1{e}^{j2\mathrm{\&pi;}(\cos \left(\frac{\mathrm{\&pi;}}{12}\right)-\cos \left(\frac{\mathrm{\&pi;}}{4}\right))}+w_2+w_3{e}^{j2\mathrm{\&pi;}\left(2\cos \left(\frac{5\mathrm{\&pi;}}{12}\right)\right)}|=\frac{1}{2}(w_1+w_2+w_3)\end{array}\right.\&DoubleRightArrow;$

$\left\{\begin{array}{c}|w_1+w_2+w_3{e}^{-j0.8966\mathrm{\&pi;}}|=\frac{1}{2}(w_1+w_2+w_3)\\ |w_1{e}^{j0.5176\mathrm{\&pi;}}+w_2+w_3{e}^{j1.0353\mathrm{\&pi;}}|=\frac{1}{2}(w_1+w_2+w_3)\end{array}\right.\&DoubleRightArrow;$

$\left\{\begin{array}{c}\sqrt{{(w_1+w_2+w_3\cos (-0.8966\mathrm{\&pi;}))}^2+{\left(w_3\sin (-0.8966\mathrm{\&pi;})\right)}^2}=\frac{1}{2}(w_1+w_2+w_3)\\ \sqrt{{(w_1\cos \left(0.5176\mathrm{\&pi;}\right)+w_2+w_3\cos \left(1.0353\mathrm{\&pi;}\right))}^2+{(w_1\sin \left(0.5176\mathrm{\&pi;}\right)+w_3\sin \left(1.0353\mathrm{\&pi;}\right))}^2}=\frac{1}{2}(w_1+w_2+w_3)\end{array},\&DoubleRightArrow;\right.$

$\left\{\begin{array}{c}\sqrt{{(w_1+w_2-0.9477w_3)}^2+{(-0.319{2w}_3)}^2}=\frac{1}{2}(w_1+w_2+w_3)\\ \sqrt{{(-0.0553w_1+w_2-0.9939w_3)}^2+{(0.998472w_1-0.11067w_3)}^2}=\frac{1}{2}(w_1+w_2+w_3)\\ w_1+w_2+w_3=1\end{array}\right.$

One group of solution that can obtain thus w is: now corresponding beam pattern is as shown in accompanying drawing 8B.

From the beam pattern shown in Fig. 8 B, can find out, near some directions beyond target pickup region (degree of 330 in Fig. 8 B) have larger gain, in actual applications, can suppose or arrange that these regions do not have source of sound to avoid affecting target pickup region.In addition, also can increase the number of microphone in pick up facility, thereby effectively eliminate the impact of secondary lobe, increase number of microphone as the equilateral triangle in figure is transformed to square or pentagon etc.

It should be noted that, the PTZ in the embodiment of the present invention controls, and is for the describing mode of a kind of pickup Region control embodiment that the present invention adopts is described better, and the control mode that also has other exists, and to this, the present invention does not limit.

Embodiment seven, the pick-up control method based on auditory localization technology.

First, by auditory localization algorithm, determine sound bearing, then, judge whether sound bearing drops in the pickup region of microphone, if dropped in the pickup region of microphone, control microphone and carry out pickup, otherwise, control microphone and do not carry out pickup or do not receive the audio signal that this microphone picks up.That is to say, choose the microphone of pickup district inclusion sound bearing, the audio signal of picking up for the microphone in pickup district inclusion sound source orientation is processed.

For above-described embodiment, carry out following some explanation below:

Illustrate 1, can adopt several different methods to form wave beam in the various embodiments described above, for example, adopt adaptive beam forming method etc.The various embodiments described above go for the pickup of narrow band signal and control, and the pickup that also goes for broadband signal is controlled.For broadband signal, can adopt subband beam-forming schemes, and can adopt from various ways such as pickup beam-forming schemes and form wave beam for each subband.

Illustrate 2, mostly the various embodiments described above be to take that 5 microphones, as example is described, can adopt the microphone of greater number in actual applications, to reach better pickup, controls effect.

Illustrate 3, when the pickup region of microphone hour, have higher signal to noise ratio, much noise, outside pickup region, therefore, can also carry out synchronous gain to audio signal corresponding to microphone and control, to embody near big and far smaller sensation.In actual design, also can directly make ∑ w _i=C increases along with pickup region 2 reducing of φ, for example, and order k is wherein proportionality constant.

In addition, the Position Control that also can present by sound, make the sound source position that presents reducing and become near with pickup region 2 φ, make voice output embody the sensation that sound furthers, for example, the positional information after target pickup area information or conversion can be passed to the output of audio frequency apparatus, by output cooperation, realize pickup and control, for example, adopt array speaker that the sound source position reappearing is changed.

Illustrate 3, in the various embodiments described above, sound can be picked as a setting to specify the outer sound in pickup region (being target pickup region), by adjusting the value of ρ, can change the audio signal in target pickup region and the proportion of background sound.In the situation that wishing that background sound is more outstanding, can get larger ρ value, the sound in the outstanding target pickup of hope region, and background sound is carried out in the situation of more filterings, can get less ρ value.A concrete example is: in embodiment tri-, if ρ=0.2, corresponding beam pattern as shown in Figure 9; If ρ=0.7, corresponding beam pattern as shown in Figure 10.

Illustrate 4, in the above-described embodiments, pick up facility can be provided with and be specifically designed to the microphone that picks up background sound, picks up the omnidirectional microphone of background sound as being specifically designed to.The microphone that can pick up for being specifically designed to background sound arranges attenuation coefficient, after the background sound picking up being decayed according to attenuation coefficient, then by the composite signal stack output corresponding with other microphones of the background sound after decay.

Illustrate 5, in the above-described embodiments, if need to use The Cloud Terrace, this The Cloud Terrace can be the The Cloud Terrace of microphone special use, can be also microphone and the shared The Cloud Terrace of camera.When microphone and the shared The Cloud Terrace of camera, can realize the Synchronization Control of shooting and pickup.The situation of the shared The Cloud Terrace of microphone and camera can be as shown in Figure 11.On The Cloud Terrace in Figure 11, be connected with a camera and five microphones, five microphones are the numbering 1 to 5 marking in Figure 11.When The Cloud Terrace level or pitching are moved, the pickup region of the camera watch region of camera and microphone all changes simultaneously.By network interface or local control interface, receiving after PTZ control signal, PTZ control signal can be converted to PT regulating command and ZOOM regulating command, use PT regulating command to control the movement of The Cloud Terrace, use ZOOM regulating command that camera and microphone make a video recordings and controlled and pickup control.In addition, can also use the shelter of microphone in Figure 11, like this, ZOOM regulating command can be for regulating the relative position of shelter and microphone.

Illustrate 6, in the above-described embodiments, for PTZ control signal design FMCC (Fast MicrophoneControl Criteria, Remote Camera control command) agreement, FMCC order can be carried by passage H.224, also can directly be carried in the messages such as TCP/UDP.Shown in following each table of a concrete example of FMCC order:

Table 1

FMCC order in table 1 comprises N byte, and each byte comprises 8bit, corresponding 1 byte of every a line of showing, and the first byte (command) is command word, and the second byte (device) is device id, and the value of the second byte can be 0～255.In an equipment, be provided with a plurality of controlled pick up facilities, during as a plurality of controlled microphone, can distinguish controlled pick up facility by device id, while being only provided with a controlled pick up facility in an equipment, the second byte can not define.All the other bytes except the first byte and the second byte are parameter, and the parameter that different command word is corresponding also can be different, and the parameter of different command can be different.The definition of the command word in table 1 is as shown in table 2:

Table 2

Command title	Value	Implication
			Start action	0xf1	Starting PTZ adjusts
Continue action	0xf2	Continuing PTZ adjusts
			Stop action	0xf3	Stopping PTZ adjusting
Store preset	0xf4	Storage PTZ position
			Activate preset	0xf5	The activation position that prestores
Set threshold	0xf6	Pickup region threshold values is set
			Send beam pattern	0xe1	Send digital beam figure

In table 2, having defined 6 kinds of FMCC orders, is respectively to start the FMCC order that PTZ adjusts, continue FMCC order that PTZ adjusts, stop FMCC order, the FMCC order of storing PTZ position, activation that PTZ adjusting prestore the FMCC order of position and the FMCC order of transmission digital beam figure.

The FMCC order that starts pick up facility PTZ adjustment is used for triggering pick up facility and carries out pickup control, and pick up facility starts to carry out pickup control after receiving the FMCC order that starts microphone PTZ adjustment.A concrete example of the FMCC order that startup microphone PTZ adjusts is as shown in table 3.

Table 3

FMCC order in table 3 comprises four bytes.The FMCC order of the first byte for representing that this FMCC order is adjusted for starting microphone PTZ.The second byte is device id.The 3rd byte and nybble are as shown in table 4 below.

Table 4

Field	Implication	Length (bit)	Value
				R/L	Pan adjusts	2	Do not carry out Pan adjustment: 0x0 level regulates left: 0x2 level regulates: 0x3 to the right
U/D	Tilt adjusts	2	Do not carry out Tilt adjustment: 0x0 pitching regulates downwards: 0x2 pitching upwards regulates: 0x3
				I/O	Zoom adjusts	2	Do not carry out Zoom adjustment: 0x0 pickup region narrows down: 0x2 pickup region broadens: 0x3
BP	Transmit beam pattern	2	Do not transmit in beam pattern: 0x00 band and transmit outside beam pattern: 0x2 band and transmit beam pattern: 0x3
				Time out	Time-out time, surpasses after time-out time, and equipment stops connecting	4	Numerical value 0x0～0xf be take 50 milliseconds as unit, such as

	Continuous adjusting, unless received continuation adjustment order or started adjustment order before overtime		0x2 represents 100 milliseconds, and 0x8 represents 400ms
				Reserved	Reserved field	4

In table 4, R/L represents the pickup of the horizontal direction of microphone to control, U/D represents the pickup of the vertical direction of microphone to control, I/O represents the pickup of the ZOOM of microphone to control, BP represents whether to feed back beam pattern and indicates and feed back in which way beam pattern when feedback beam pattern, Time out represents time-out time, the timing length that pickup is controlled, and Reserved is for retaining content.

When FMCC order indication that startup PTZ that controlled device receives adjusts need to return beam pattern and need outside band transmission beam pattern (BP=0x03), controlled device can be set up media channel in addition, and utilizing this media channel of setting up in addition to transmit beam pattern, controlled device also can adopt the mode of the beam pattern that superposes on existing image to transmit beam pattern by existing media channel.Afterwards, controlled device, after receiving the FMCC order that stops PTZ adjustment, is closed the media channel of above-mentioned other foundation or the operation of the beam pattern that stops superposeing.A concrete example that transmits beam pattern is: in video conference application, open through consultation a logical channel, to transmit beam pattern, beam pattern can adopt and H.264 wait video or coding of graphics Protocol compression to transmit.Another the concrete example that transmits beam pattern is: in video conference application, the beam pattern that superposes on the live image of catching at video camera or film content image transmits together.

When FMCC order indication that startup PTZ that controlled device receives adjusts need to return beam pattern and need in band transmission beam pattern (BP=0x02), controlled device need to be by sending the FMCC order passback beam pattern information of digital beam figure, and the beam pattern information of passback can be the coordinate information of beam pattern.

The FMCC order that continues PTZ adjustment is used for impelling pick up facility to proceed pickup control, and a concrete example of the FMCC order that continuation microphone PTZ adjusts is as shown in table 5.

Table 5

FMCC order in table 5 comprises three bytes.The FMCC order of the first byte for representing that this FMCC order is adjusted for continuing PTZ.The second byte is device id.The timing length that the high 4 bit Time out of the 3rd byte control for resetting pickup, be that pick up facility resets timer according to the value of the Time out in the FMCC order of continuation microphone PTZ adjustment, and proceed PTZ and regulate, the value of Time out can be identical with the value of Time out in table 4.The low 4 bit Reserved of the 3rd byte are for retaining content.

The FMCC order that stops PTZ adjustment is no longer carried out pickup control for controlling pick up facility, and pick up facility stops pickup control operation after receiving the FMCC order that stops PTZ adjustment.A concrete example that stops the FMCC order that PTZ adjusts is as shown in table 6.

Table 6

FMCC order in table 6 comprises two bytes.The FMCC order of the first byte for representing that this FMCC order is adjusted for stopping PTZ.The second byte is device id.The FMCC order that stops PTZ adjustment can not have parameter.

The FMCC order of storage PTZ position is preserved current PTZ positional information for triggering pick up facility, be to obtain the current PTZ positional information of each pick up facility storage after pick up facility receives the FMCC order of storing PTZ position, the current PTZ positional information of pick up facility can be to there being numbering, when the current PTZ information of storage microphone, corresponding numbering can be stored together, so that follow-up index.A concrete example of the FMCC order of storage PTZ position is as shown in table 7.

Table 7

FMCC order in table 7 comprises three bytes.The first byte is for representing that this FMCC order is for the FMCC order of storage PTZ position.The second byte is device id.The Preset number of high 4 bits of the 3rd byte represents Position Number, the span of Preset number can be 0～15, and the content of pick up facility storage can be value and microphone PTZ positional information corresponding to this Preset number of Preset number.The low 4 bit Reserved of the 3rd byte are for retaining content.

The prestore FMCC order of position of activation is carried out pickup control for triggering pick up facility according to the information that prestores, be that pick up facility receives after the FMCC order that activates the position that prestores, obtain the pick up facility PTZ positional information prestoring, and carry out pickup control according to the microphone PTZ positional information prestoring.A concrete example of the FMCC order of the microphone position that activation prestores is as shown in table 8.

Table 8

FMCC order in table 8 comprises three bytes.The first byte is for representing that this FMCC order is for activating the FMCC order of the position that prestores.The second byte is device id.The Presetnumber of high 4 bits of the 3rd byte represents Position Number corresponding to microphone PTZ positional information activating, and same, the span of Preset number can be 0～15.The low 4 bit Reserved of the 3rd byte are for retaining content.

Pickup region threshold values is set for pickup edges of regions being set with respect to center amplitude fading ratio, can reaches the effect that regulates the audio signal in target pickup region and the proportion of background sound, an object lesson is as shown in table 9.

Table 9

FMCC order in table 9 comprises three bytes.The first byte is for representing that this FMCC order is for arranging the FMCC order of pickup region threshold values.The second byte is device id.The Threshold of high 4 bits of the 3rd byte represents to arrange pickup edges of regions with respect to center amplitude fading ratio, and span can be 1～9, respectively correspondence 0.1～0.9.The low 4 bit Reserved of the 3rd byte are for retaining content.

The FMCC order that sends digital beam figure is fed back beam pattern for pick up facility to control terminal, for example, controlled device is after receiving the FMCC order that starts microphone PTZ adjustment, if the BP in this FMCC order represents to be with interior transmission beam pattern, controlled device generates beam pattern according to the current pickup region of pick up facility, and utilizes the FMCC order that sends digital beam figure to send beam pattern.A concrete example of the FMCC order of transmission digital beam figure is as shown in table 10.

Table 10

FMCC order in table 10 comprises N byte.The first byte is for representing that this FMCC order is for sending the FMCC order of digital beam figure.The second byte is device id.The 3rd byte is for representing the numerical value of pick up facility present level direction, and nybble is for representing the numerical value of the current vertical direction of pick up facility.The 5th byte is for representing the ZOOM that pick up facility is current.The 6th byte and the 7th byte are for representing counting of beam pattern.The Eight characters is saved in the precision that represents beam pattern.The 9th byte is for representing the compress mode of beam pattern.Subsequent byte is as the description in table 10.

When controlled device returns beam pattern in carrying out band, both can only transmit P/T/Z angle information, also can only transmit beam pattern, can also the two transmit simultaneously.In addition, the describing mode that controlled device also can be converted to beam pattern rectangular coordinate transmits.The beam pattern here can adopt polar coordinate mode pointwise to describe.Controlled device can utilize this FMCC order to transmit sparse or fine and close beam pattern as required, and the sparse or fine and close value by n is here determined.The receiving terminal of received beam figure can carry out interpolation smoothing processing by the beam pattern receiving.

Also can realize the transmission of PTZ control signal and the transmission of beam pattern for pick up facility by increase the mode of field in the order of (as agreement H.281) of existing camera control agreement.

When video camera and pick up facility carry out PTZ while adjusting simultaneously, video camera can be followed pick up facility and be carried out PTZ adjustment, not be used in the order of independent transmission camera control; Pick up facility also can controlled terminal be set follows video camera and carries out PTZ adjustment, so just can use existing camera control agreement to adjust the PTZ position of pick up facility simultaneously, also can in the order of camera control agreement, indicate pick up facility and follow video camera and regulate (need to expand to pick up facility is set and follow video camera adjustment camera control agreement), or also can indicate by independent negotiation pick up facility and follow video camera and regulate; Control terminal also can send for the control command of video camera simultaneously and for the control command of pick up facility, realize the synchronous adjustment of the two.

The order of the PTZ control signal of transmitting by local control interface is substantially similar to foregoing description, no longer the command format of the PTZ control signal of transmitting by local control interface is elaborated here.

The present invention also provides a kind of embodiment of pickup control device, and referring to Figure 12, this pickup control device comprises:

Receiver module 1201, for receiving the control signal of carrying out the adjusting of pickup region for pick up facility, makes the pickup region of pick up facility be adjusted to target pickup region by described control signal;

Parameter determination module 1202, for determining that according to described control signal the pickup region in target pickup region regulates parameter;

Pickup region adjustment module 1203, for regulating parameter to carry out pickup control at least one microphone of described pick up facility according to described pickup region, makes the pickup region corresponding to audio signal of described pick up facility output conform to described target pickup region.

Optionally, referring to Figure 13, described device also comprises as lower module:

Pickup is controlled stopping modular 1204, for receiving, includes after the control signal that stops pickup control information, stops the reception of pickup control signal.

By embodiments of the invention pickup control appliance, can receive pickup and stop control message, facilitate user's operation to control.

Optionally, referring to Figure 14, described parameter determination module 1202 specifically comprises: signal transformation parameter determination module 1205, the parameter of carrying out signal conversion for definite signal that at least one microphone of described pick up facility is picked up;

Described pickup region adjustment module 1203 comprises:

Parameter transformation unit 12031, carries out corresponding conversion for the audio signal that the microphone of pending audio signal adjustment is picked up and obtains changing signal afterwards;

Synthesis unit 12032, for the signal of the microphone after parameter transformation of described pick up facility is synthesized, obtains the audio signal of described pick up facility output.

Adopt embodiments of the invention can get corresponding audio signal transformation parameter, the audio signal of picking up of pick up facility is converted, effectively solved in prior art and cannot realize by extraneous control signal the problem of the control of pick up facility.

Optionally, referring to Figure 15, described in carry out signal conversion parameter be: the amplitude that in described pick up facility, at least one microphone is corresponding adjusts parameter and/or phase place is adjusted parameter;

Described parameter determination module 1202 specifically comprises: adjust parameter determination module 1206, for amplitude adjustment parameter and/or the phase place adjustment parameter of determining that at least one microphone of described pick up facility is corresponding;

Described pickup region adjustment module 1203 comprises:

Parameter transformation unit 12033, carries out amplitude adjustment and/or phase place adjustment for utilizing described amplitude adjustment parameter and/or phase place to adjust parameter at least one microphone of described pick up facility;

Synthesis unit 12034, for the signal of the microphone through parameter transformation of described pick up facility is synthesized, obtains the audio signal of described pick up facility output.

Wherein, the parameter of adjusting as audio frequency signal amplitude by the weighted value in embodiment of the method for the present invention, adjusts parameter by delay parameter as the phase place of the audio signal of picking up of pick up facility.

Embodiments of the invention, by obtaining outside pickup Region control signal, realize the control that the audio signal that pick up facility is picked up is carried out amplitude adjustment and/or phase place adjustment, effectively solved the problem of the interfaceization control that cannot realize pick up facility of prior art existence.

Optionally, referring to Figure 16, described in carry out signal conversion parameter be: at least one microphone of described pick up facility carries out the position moving parameter of translation and/or rotation;

Described parameter determination module 1202 specifically comprises: position moving parameter determination module 1207, for the position moving parameter of determining that at least one microphone of described pick up facility carries out translation and/or rotation;

Described pickup region adjustment module 1203 specifically comprises:

Control unit 12035, for utilizing the position moving parameter of described translation and/or rotation carry out translation and/or rotate and control at least one microphone of described pick up facility, make to connect in check each microphone and reach the position moving parameter determined position corresponding with each microphone.

Optionally, referring to Figure 17, control unit 12035 described above comprises:

Translation position control unit 120351, for move at least one microphone and/or the shelter that regulates pick up facility described in parameter adjustment according at least one microphone translation position of described pick up facility, to adjust the relative position of the relative shelter of at least one microphone of described pick up facility;

Turned position control unit 120352, regulates parameter to carry out level angle and/or luffing angle adjustment at least one microphone of described pick up facility for moving according to described turned position.

Pass through embodiments of the invention, can realize the function that microphone to comprising in pick up facility carries out position adjustments, can realize the translation control of the microphone that pick up facility is comprised and/or rotate and control according to outside pickup Region control signal, by the effective control to the microphone of pick up facility, can effectively regulate the pickup region of pick up facility.

Optionally, referring to Figure 18, described in carry out signal conversion parameter be: whether at least one microphone of described pick up facility the parameter of pickup;

Described parameter determination module 1202 specifically comprises: pickup determination module 1208, at least one microphone of determining described pick up facility parameter of pickup whether;

Described pickup region adjustment module 1203 comprises: for determine target pickup region according to described control signal, and according to auditory localization algorithm, determine the position of sound source; Whether the position that judges described sound source is positioned at described target pickup region, and if so, adjusting parameter in described pickup region is that pickup is confirmed parameter, otherwise is that non-pickup is confirmed parameter;

When described pick up facility gets pickup confirmation parameter, control the audio signal that at least one microphone of described pick up facility picks up, otherwise at least one microphone of controlling described pick up facility does not carry out picking up of audio signal or audio signal that at least one microphone of described pick up facility is picked up is not obtained.

Whether embodiments of the invention, can carry out pickup to pick up facility and effectively control, and solved in prior art and cannot carry out by obtaining external parameter the problem of the adjustment of pickup region and pickup signal.

Optionally, when the microphone number of described pick up facility is at least four, all microphones distribute at grade, or other microphones except the first microphone of pick up facility are polygon and distribute, the first microphone of described pick up facility and described other microphones are polygonal pyramid shape and distribute.

The present embodiment provides the layout type of a plurality of microphones of pick up facility, by different layout type, can effectively to pickup region, control.

Wherein, the maximum of the spacing of two microphones arbitrarily of described pick up facility and the sine value of the maximum pickup angle of described single microphone are inverse ratio.

Optionally, described pick up facility is also provided with and is exclusively used in the microphone that picks up background sound, described for the audio signal stack after picking up background sound that the microphone of background sound picks up and controlling with described pickup after overdamping.

Wherein, described pickup control device also comprises: background sound adjustment module, for the control signal regulating from pickup region, extract for controlling background sound than the control parameter of re-correlation, according to this, control parameter at least one microphone of described pick up facility is carried out to pickup control, make the audio signal background sound proportion respective change of output.

By embodiments of the invention, can effectively change in prior art and cannot realize the adjusting problem that the audio signal that pick up facility is obtained is carried out foreground voice and background sound, by embodiments of the invention, can

Figure 19 is one of the present invention and realizes technical scheme block diagram, wherein

Microphone unit comprises one or for a plurality of (array) directional microphones and/or the Mike of omnidirectional;

Network interface is for receiving the PTZ control command to microphone of far-end by network, network interface can be IP network based on packet switching or Circuit-switched ISDN, E1 network, comprise wired (as Ethernet, xDSL etc.) and wireless (as WiFi, WiMAX, UMTS, CDMA2000, TD-SCDMA) access way, by far-end control protocol, realize the control of far-end to pick up facility;

Local control interface is for receiving the local PTZ control command to microphone, and interface can be the wired or wireless interfaces such as infrared, bluetooth, RS232, completes the control of local pick up facility by local control protocol;

PTZ control unit is converted to pickup region regulon and the required parameter of The Cloud Terrace (optional) by PTZ control signal;

The digital audio and video signals of pickup region regulon pair array Mike input carries out the processing such as weighting of phase place and amplitude, the audio signal of output and PTZ corresponding region, the extra-regional signal of filtering.Pickup region regulon also can adopt the mode in prior art 1 to carry out ZOOM adjusting, by hiding relation, regulates pickup angle, mechanically replaces array microphone to carry out ZOOM adjusting;

The Cloud Terrace (optionally), mechanically substitute array microphone carries out the adjustment of level (P) and pitching (T);

Audio adjustment unit, further carries out the amplification (can synchronize with video scaling) of sound, background sound special processing etc.

In practical adjustments process, in order there to be real-time feedback effects, can adopt continuous regulative mode, be that user sends an order that starts adjusting, PTZ control module just regulates parameter (take certain step-length as increment) with the lasting generation of certain frequency, until user sends the order that stops adjusting.

Through the above description of the embodiments, those skilled in the art can be well understood to the mode that the present invention can add essential hardware platform by software and realize, can certainly all by hardware, implement, but in a lot of situation, the former is better execution mode.Understanding based on such, what technical scheme of the present invention contributed to background technology can embody with the form of software product in whole or in part, this computer software product can be stored in storage medium, as ROM/RAM, magnetic disc, CD etc., comprise that some instructions are with so that a computer equipment (can be personal computer, server, or the network equipment etc.) carry out the method described in some part of each embodiment of the present invention or embodiment.

Although described the present invention by embodiment, those of ordinary skills know, the present invention has many distortion and variation and do not depart from spirit of the present invention, and the claim of application documents of the present invention comprises these distortion and variation.

Claims (18)

1. a pick-up control method, is characterized in that, comprising:

The control signal of pickup Region control is carried out in reception to pick up facility, by described control signal, make the pickup region of pick up facility be adjusted to target pickup region;

The pickup region of determining target pickup region according to described control signal regulates parameter;

According to described pickup region, regulate parameter to carry out pickup control at least one microphone in described pick up facility, the pickup region corresponding to audio signal of described pick up facility output conformed to described target pickup region;

The described pickup region adjusting parameter of determining target pickup region according to described control signal, at least one microphone in described pickup region is carried out to pickup to be controlled and to comprise: when described control signal comprises the log-on message that pickup controls, utilize the pickup region in target pickup region to regulate parameter to regulate described pick up facility, until receive to include for described pick up facility, stop control signal that pickup controlling or until adjusted pre-determined number or reached scheduled duration until continue duration;

Described pickup region regulates parameter to comprise: the parameter that the signal that at least one microphone of described pick up facility is picked up carries out signal conversion;

And describedly according to described pickup region, regulate parameter to carry out pickup at least one microphone of described pick up facility to control and comprise:

When regulating parameter, described pickup region carries out pickup while controlling for a microphone of pick up facility, the audio signal of according to the parameter of described signal conversion, this microphone being picked up is carried out the signal after corresponding conversion, the audio signal that signal after this conversion and other microphones of described pick up facility are picked up is synthesized, with filtering or reduce not belong to the audio signal in described target pickup region;

When regulating parameter, described pickup region carries out pickup while controlling for two of pick up facility and plural microphone, the audio signal of picking up for described two and plural microphone utilizes respectively the parameter of its corresponding signal conversion to carry out the signal of corresponding conversion after obtaining changing, the audio signal that signal after the audio signal conversion that these two or more microphones are picked up and other microphones of described pick up facility pick up is synthesized, with filtering or reduce not belong to the audio signal in described target pickup region.

2. the method for claim 1, is characterized in that, the described parameter that the signal of at least one microphone of pick up facility is carried out to signal conversion is: the amplitude that in described pick up facility, at least one microphone is corresponding adjusts parameter and/or phase place is adjusted parameter;

And describedly according to described pickup region, regulate parameter to carry out pickup at least one microphone of described pick up facility to control and comprise:

When regulating parameter, described pickup region carries out pickup while controlling for a microphone of pick up facility, signal after adjusting parameter and/or phase place and adjust the amplitude of the audio signal that parameter picks up this microphone and/or phase place and carry out being converted accordingly according to described amplitude, the audio signal that signal after this conversion and other microphones of described pick up facility are picked up is synthesized, with filtering or reduce not belong to the audio signal in described target pickup region;

When regulating parameter, described pickup region carries out pickup while controlling for two of pick up facility and plural microphone, the audio signal of picking up for described two and plural microphone is utilized respectively its corresponding amplitude to adjust parameter and/or phase place and is adjusted parameter and carry out the signal of corresponding conversion after obtaining changing, the audio signal that signal after the audio signal conversion that these two or more microphones are picked up and other microphones of described pick up facility pick up is synthesized, with filtering or reduce not belong to the audio signal in described target pickup region.

3. the method for claim 1, is characterized in that, described pickup region regulates parameter to comprise: at least one microphone of described pick up facility carries out the position moving parameter of translation and/or rotation;

And describedly according to described pickup region, regulate parameter to carry out pickup at least one microphone of described pick up facility to control and comprise:

When described pickup region regulates parameter to be a microphone for described pick up facility, utilize the position moving parameter of described translation and/or rotation carry out translation and/or rotate and control described microphone, this microphone is reached and this determined position of position moving parameter;

When described pickup region regulates parameter to be a plurality of microphone for described pickup region, described in utilizing, for the translation of each microphone and/or the position moving parameter of rotation, described each microphone carried out respectively translation and/or rotates and control, making each microphone reach the position moving parameter determined position corresponding with each microphone.

4. method as claimed in claim 3, is characterized in that, the position moving parameter of the translation of at least one microphone of described pick up facility is: adjusting parameter is moved in the translation position corresponding to pickup angle of described at least one microphone of pick up facility; The position moving parameter of the rotation of at least one microphone of described pick up facility is: adjusting parameter is moved in the turned position corresponding to pickup orientation of at least one microphone of described pick up facility;

And describedly according to described pickup region, regulate parameter to carry out pickup at least one microphone of described pick up facility to control and comprise:

According at least one microphone translation position of described pick up facility, move at least one microphone and/or the shelter that regulates pick up facility described in parameter adjustment, to adjust the relative position of the relative shelter of at least one microphone of described pick up facility;

And/or

According to described turned position, move and regulate parameter to carry out level and/or luffing angle adjustment at least one microphone of described pick up facility.

5. the method for claim 1, is characterized in that, described pickup region regulates parameter to comprise: whether at least one microphone of described pick up facility the parameter of pickup;

And the described pickup region adjusting parameter of determining target pickup region according to described control signal, regulates parameter to carry out pickup control at least one microphone of described pick up facility according to described pickup region and comprises:

According to described control signal, determine target pickup region, and according to auditory localization algorithm, determine the position of sound source;

Whether the position that judges described sound source is positioned at described target pickup region, and if so, adjusting parameter in described pickup region is that pickup is confirmed parameter, otherwise is that non-pickup is confirmed parameter;

When described pick up facility gets pickup confirmation parameter, control the audio signal that at least one microphone of described pick up facility picks up, otherwise at least one microphone of controlling described pick up facility does not carry out picking up of audio signal or audio signal that at least one microphone of described pick up facility is picked up is not obtained.

6. the method as described in claim 1 or 4 any one, is characterized in that, describedly according to described pickup region, regulates parameter to carry out pickup control to described pick up facility also to comprise:

The gain of the composite signal of the audio signal that each microphone of described pick up facility is picked up is adjusted, and described gain reduces and increases with the pickup angle of described pick up facility.

7. the method for claim 1, it is characterized in that, the control signal that described reception is carried out pickup Region control for pick up facility also comprises: receive and control background sound than the control parameter of re-correlation, according to this, control parameter described pick up facility is carried out to pickup control, make the audio signal background sound proportion respective change of output.

8. the method for claim 1, is characterized in that, described in carry out the adjusting of pickup region control signal be the P/T/Z control signal to described pick up facility for pickup region.

9. a pickup control device, is characterized in that, comprising:

Receiver module, for receiving the control signal of carrying out the adjusting of pickup region for pick up facility, makes the pickup region of pick up facility be adjusted to target pickup region by described control signal;

Parameter determination module, for determining that according to described control signal the pickup region in target pickup region regulates parameter;

Pickup region adjustment module, for regulating parameter to carry out pickup control at least one microphone of described pick up facility according to described pickup region, makes the pickup region corresponding to audio signal of described pick up facility output conform to described target pickup region;

Described parameter determination module is specially: signal transformation parameter determination module, the parameter of carrying out signal conversion for definite signal that at least one microphone of described pick up facility is picked up;

Described pickup region adjustment module comprises:

Parameter transformation unit, carries out corresponding conversion for the audio signal that the microphone of pending audio signal adjustment is picked up and obtains changing signal afterwards;

Synthesis unit, for the signal of the microphone after parameter transformation of described pick up facility is synthesized, obtains the audio signal of described pick up facility output.

10. device as claimed in claim 9, is characterized in that, described device also comprises:

Pickup is controlled stopping modular, for receiving, includes after the control signal that stops pickup control information, stops the reception of pickup control signal.

11. devices as claimed in claim 9, is characterized in that, described in carry out signal conversion parameter be: the amplitude that in described pick up facility, at least one microphone is corresponding adjusts parameter and/or phase place is adjusted parameter;

Described parameter determination module comprises: adjust parameter determination module, for amplitude adjustment parameter and/or the phase place adjustment parameter of determining that at least one microphone of described pick up facility is corresponding;

Described pickup region adjustment module comprises:

Parameter transformation unit, carries out amplitude adjustment and/or phase place adjustment for utilizing described amplitude adjustment parameter and/or phase place to adjust parameter at least one microphone of described pick up facility;

Synthesis unit, for the signal of the microphone through parameter transformation of described pick up facility is synthesized, obtains the audio signal of described pick up facility output.

12. devices as claimed in claim 9, is characterized in that, described in carry out signal conversion parameter be: at least one microphone of described pick up facility carries out the position moving parameter of translation and/or rotation;

Described parameter determination module comprises: position moving parameter determination module, for the position moving parameter of determining that at least one microphone of described pick up facility carries out translation and/or rotation;

Described pickup region adjustment module comprises:

Control unit, for utilizing the position moving parameter of described translation and/or rotation carry out translation and/or rotate and control at least one microphone of described pick up facility, make to connect in check each microphone and reach the position moving parameter determined position corresponding with each microphone.

13. devices as claimed in claim 12, is characterized in that, described control unit comprises:

Translation position control unit, for move at least one microphone and/or the shelter that regulates pick up facility described in parameter adjustment according at least one microphone translation position of described pick up facility, to adjust the relative position of the relative shelter of at least one microphone of described pick up facility;

Turned position control unit, regulates parameter to carry out level angle and/or luffing angle adjustment at least one microphone of described pick up facility for moving according to described turned position.

14. devices as claimed in claim 9, is characterized in that, described in carry out signal conversion parameter be: whether at least one microphone of described pick up facility the parameter of pickup;

Described parameter determination module comprises: pickup determination module, at least one microphone of determining described pick up facility parameter of pickup whether;

Described pickup region adjustment module comprises: for determine target pickup region according to described control signal, and according to auditory localization algorithm, determine the position of sound source; Whether the position that judges described sound source is positioned at described target pickup region, and if so, adjusting parameter in described pickup region is that pickup is confirmed parameter, otherwise is that non-pickup is confirmed parameter;

When described pick up facility gets pickup confirmation parameter, control the audio signal that at least one microphone of described pick up facility picks up, otherwise at least one microphone of controlling described pick up facility does not carry out picking up of audio signal or audio signal that at least one microphone of described pick up facility is picked up is not obtained.

15. devices as claimed in claim 9, it is characterized in that, when the microphone number of described pick up facility is at least four, all microphones distribute at grade, or other microphones except the first microphone of pick up facility are polygon and distribute, the first microphone of described pick up facility and described other microphones are polygonal pyramid shape and distribute.

16. devices as claimed in claim 15, is characterized in that, the maximum of the spacing of two microphones arbitrarily of described pick up facility and the sine value of the maximum pickup angle of single microphone are inverse ratio.

17. devices as claimed in claim 9, it is characterized in that, described pick up facility is also provided with and is exclusively used in the microphone that picks up background sound, described for the audio signal stack after picking up background sound that the microphone of background sound picks up and controlling with described pickup after overdamping.

18. devices as claimed in claim 17, it is characterized in that, described device also comprises: background sound adjustment module, for the control signal regulating from pickup region, extract for controlling background sound than the control parameter of re-correlation, according to this, control parameter described pick up facility is carried out to pickup control, make the audio signal background sound proportion respective change of output.