CN102137318A - Method and device for controlling adapterization - Google Patents

Method and device for controlling adapterization Download PDF

Info

Publication number
CN102137318A
CN102137318A CN2010101032444A CN201010103244A CN102137318A CN 102137318 A CN102137318 A CN 102137318A CN 2010101032444 A CN2010101032444 A CN 2010101032444A CN 201010103244 A CN201010103244 A CN 201010103244A CN 102137318 A CN102137318 A CN 102137318A
Authority
CN
China
Prior art keywords
microphone
facility
pickup
parameter
pick
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN2010101032444A
Other languages
Chinese (zh)
Other versions
CN102137318B (en
Inventor
苏红宏
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Global Innovation Polymerization LLC
Tanous Co
Original Assignee
Huawei Device Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Huawei Device Co Ltd filed Critical Huawei Device Co Ltd
Priority to CN201010103244.4A priority Critical patent/CN102137318B/en
Priority to PCT/CN2011/070452 priority patent/WO2011088796A1/en
Publication of CN102137318A publication Critical patent/CN102137318A/en
Application granted granted Critical
Publication of CN102137318B publication Critical patent/CN102137318B/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R3/00Circuits for transducers, loudspeakers or microphones
    • H04R3/005Circuits for transducers, loudspeakers or microphones for combining the signals of two or more microphones

Landscapes

  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Otolaryngology (AREA)
  • Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Acoustics & Sound (AREA)
  • Signal Processing (AREA)
  • Circuit For Audible Band Transducer (AREA)

Abstract

The embodiment of the invention discloses a method and a device for controlling adapterization. The method for controlling adapterization comprises the following steps of: receiving a control signal for controlling an adapterization region aiming at adapterization equipment, and regulating the adapterization region of the adapterization equipment to a target adapterization region by the control signal; determining an adapterization region regulation parameter of the target adapterization region according to the control signal; and performing adapterization control on at least one microphone of the adapterization equipment according to the adapterization region regulation parameter so that the adapterization region corresponding to an audio signal output by the adapterization equipment accords with the target adapterization region. By the technical scheme, the adapterization control over the microphone of the adapterization equipment can be realized by the control signal and the conversion process of the control signal; moreover, as the control signal can be transmitted through a network interface and a local control interface, the interface control over the adapterization equipment is realized.

Description

Pick-up control method and device
Technical field
The present invention relates to multimedia technology field, be specifically related to pick-up control method and device.
Background technology
When using video conference, often need the zone of picking up sound is controlled, for example, certain sound is furthered (amplification), for another example, avoid noise source etc.; To reach better video conference effect.At present, mainly contain two kinds of pick-up control methods.
Method one, based on the pick-up control method of the control position of microphone in the cylinder shelter.
Have optics and acoustics synchronously " focusing " camera structure as shown in Figure 1.Microphone among Fig. 1 (11) is arranged in cylinder shelter (12), and when adjusting optical lens angle (zoom), the position of microphone (11) in the cylinder shelter also can change thereupon, thereby realized pickup control.
In realizing process of the present invention, the inventor finds: the pickup control of method one must be carried out synchronously with image pickup control, can not independently carry out pickup control; And owing to microphone (11) can only move forward and backward in cylinder shelter (12), therefore only realized the zoom adjustment, can not carry out the adjustment of level and vertical direction, can not produce the variation of position sense, and, therefore can not handle background sound and foreground voice etc. flexibly because the sound outside the pickup angle can not enter microphone (11); In addition, method one can not be applicable in many Mikes' the pickup environment, and can not carry out the interface chemical control system of pickup.
Method two, based on the pick-up control method of left and right acoustic channels output.Be that example describes method two below with Fig. 2.
16a among Fig. 2 and 16b are two MIC of omnidirectional (Mike), by the gain of control amplifier 19a, 19b and 19c, realize the zoom control to MIC.For example, when the zoom of MIC need be adjusted into " wide-angle ", zoom control section (12) can 19a and the gain of 19b be set to 1 promptly maximumly, the gain of 19c is set to 0; When the zoom of MIC need be adjusted into " furthering ", zoom control section (12) can 19a and the gain of 19b be set to 0, the gain of 19c is set to 1.Like this, utilize left and right acoustic channels output to realize wide-angle/further.
In realizing process of the present invention, the inventor finds: method two has only been realized the zoom adjustment, can not carry out the adjustment of level and vertical direction, can not produce the variation of position sense, and zoom adjusts more extensive; In addition, method two must be realized pickup control by dual track output, can not be applicable in the monaural pickup environment, and can not carry out the interface chemical control system of pickup.
In summary it can be seen that prior art can't be carried out the control of pickup zone interfaceization to pick up facility, can not satisfy the demand for control of user flexibility.
Summary of the invention
Pick-up control method that embodiment of the present invention provides and device are to have realized the interface control in the pickup process.
The pick-up control method that embodiment of the present invention provides comprises: receive the control signal of carrying out the pickup Region control at pick up facility, make the pickup zone of pick up facility be adjusted to target pickup zone by described control signal;
Determine the pickup zone adjusting parameter in target pickup zone according to described control signal;
Regulate parameter according to described pickup zone at least one microphone in the described pick up facility is carried out pickup control, the pickup zone of the audio signal correspondence of described pick up facility output is conformed to described target pickup zone.
On the other hand, also provide a kind of pickup control device, this device comprises:
Receiver module is used to receive at pick up facility and carries out the control signal that the pickup zone is regulated, and makes the pickup zone of pick up facility be adjusted to target pickup zone by described control signal;
Control module determines that according to described control signal parameter is regulated in the pickup zone in target pickup zone;
Pickup zone adjustment module is regulated parameter according to described pickup zone at least one microphone of described pick up facility is carried out pickup control, and the pickup zone of the audio signal correspondence of described pick up facility output is conformed to described target pickup zone.
Description by technique scheme as can be known, the embodiment of the invention determines that by receiving at the pickup Region control signal of pick up facility and by this pickup Region control signal the pickup zone adjusting parameter in target pickup zone realizes the pickup control to the microphone in the pick up facility, and embodiments of the invention can make the convenient pickup zone to pick up facility of user control easily.
Description of drawings
Fig. 1 is the schematic diagram of the pick-up control method one of prior art;
Fig. 2 is the schematic diagram of the pick-up control method two of prior art;
Fig. 3 is the pick-up control method flow chart of the embodiment of the invention one;
Fig. 4 is the principle schematic based on the pick-up control method of weight of the embodiment of the invention two;
Fig. 5 A is the pick-up control method flow chart of the embodiment of the invention three;
Fig. 5 B is the microphone distribution schematic diagram of the embodiment of the invention three;
Fig. 6 is the source of sound and the microphone position schematic diagram of the embodiment of the invention four;
Fig. 7 A is the The Cloud Terrace schematic diagram that is provided with microphone of the embodiment of the invention five;
Fig. 7 B is the schematic diagram of the microphone pickup angle of the embodiment of the invention five;
Fig. 7 C is the beam pattern that draws in polar coordinate system of the embodiment of the invention five;
Fig. 8 A is the source of sound and the microphone position schematic diagram of the embodiment of the invention six;
Fig. 8 B is the beam pattern of the embodiment of the invention six;
Fig. 9 is the beam pattern of ρ in the embodiment of the invention three=0.2 o'clock;
Figure 10 is the beam pattern of ρ in the embodiment of the invention three=0.7 o'clock;
Figure 11 is the microphone of the embodiment of the invention and the schematic diagram of the shared The Cloud Terrace of camera;
Figure 12 is the composition schematic diagram of pickup control device embodiment one of the present invention;
Figure 13 is the composition schematic diagram of pickup control device embodiment two of the present invention;
Figure 14 is the composition schematic diagram of pickup control device embodiment three of the present invention;
Figure 15 is the composition schematic diagram of pickup control device embodiment four of the present invention;
Figure 16 is the composition schematic diagram of pickup control device embodiment five of the present invention;
Figure 17 is the composition schematic diagram of control unit among the pickup control device embodiment five of the present invention;
Figure 18 is the composition schematic diagram of pickup control device embodiment six of the present invention;
Figure 19 is the block diagram of an implementation of the present invention.
Embodiment
The embodiment of embodiment one, pick-up control method.The flow process of this method as shown in Figure 3.
Among Fig. 3, S300, receive the control signal of pick up facility being carried out the pickup Region control, make the pickup zone of pick up facility be adjusted to target pickup zone by described control signal.
Optionally, the pick up facility here can include one or more microphones.The microphone here can be omnidirectional microphone or directional microphone, and a plurality of microphones can form microphone array.
Optionally, all microphones in the microphone array can be in the same plane, for example, all microphones are formed a plane polygon, and this polygon can be the regular polygon that the length of side equates, and, in polygonal center a microphone can be set.Optionally, pick up facility in the present embodiment can also be provided with a microphone specially at background sound, the background sound dedicated microphone can be positioned at same plane with other microphones in the pick up facility, also can be positioned at different planes with other microphones in the pick up facility.
Optionally, all microphones in the pick up facility also can be positioned on the Different Plane, a concrete example is: all microphones are with the distribution of shapes of many ribs vertebra, the summit of described polygonal pyramid is the position of microphone, and many ribs vertebra here can be: triangular pyramid, rectangular pyramid, pentagonal pyramid or more polygon pyramid or the like.Optionally, the bottom of pyramid can be a regular polygon, and the summit of rib vertebra can be positioned at perpendicular to regular polygon and passes on the straight line at center of regular polygon.
Optionally, the control signal of carrying out pickup Region control or adjusting of at least one microphone of above-mentioned reception can be the control signal that receives by network interface, the control signal of this moment can be based on the control signal of far-end control protocol, and network interface can be based on the IP network interface of packet switching, also can be based on Circuit-switched ISDN or E1 network interface etc.Wired (as Ethernet, xDSL, xPON) access way that the access way of network insertion can comprise and wireless (as WiFi, GSM, WiMAX) access way.
Optionally, the control signal of carrying out the pickup Region control of above-mentioned reception also can be the control signal that receives by local control interface, is that remote controller sends, passes through the local control interface control signals transmitted as the control signal that receives.Local control interface can be wireline interface (as RS232 etc.), also can be wave point (as infrared interface, blue tooth interface etc.).
Optionally, the content that the control signal among the S300 comprises can have multiple different situation, and for example, this control signal includes the information that starts pickup control; Again for example, control signal except including the information that starts pickup control, can also include adjustment step-length information, target pickup area information and the pickup control number of times of pickup control duration, pickup control isoparametric any one or a plurality of.Optionally, control signal can include the information carry out the information of pickup control or to proceed pickup control or the information in the target pickup zone that activation prestores of stopping.Above-mentioned pickup control duration can be realized by timer, promptly before the timer expiry, carries out follow-up S310 and/or S320; Work as timer expiry, then stop the execution of S310 and/or S320.Optionally, utilize the adjustment step-length information of above-mentioned pickup control can produce the pickup zone adjusting parameter in target pickup zone, but this target pickup zone might not be final objective pickup zone, and may be the interim target pickup zone in the complete pickup control procedure.Optionally, above-mentioned pickup control number of times can be realized by counter, promptly before counter reaches predetermined count value, normally carries out follow-up S310 and/or S320; When counter reaches predetermined count value, stop the execution of follow-up S310 and/or S320.The content that control signal specifically comprises has detailed illustrating in subsequent embodiment.In addition, agreement that control signal adopts and concrete form can be provided with according to actual needs, and present embodiment does not limit concrete agreement and the concrete form that control signal adopts.
S310, determine that according to described control signal the pickup zone in target pickup zone regulates parameter.
The control signal that is about to receive is converted to the pickup zone in target pickup zone and regulates parameter.
When this control signal includes the information that starts pickup control, can determine target pickup zone based on the adjustment step-length information of pickup control, for example, determine target pickup zone according to the current location and the adjustment step-length information of pick up facility microphone.At this moment, can carry out the conversion process operation that parameter is regulated in the pickup zone according to adjusting step-length information.The adjustment step-length information of the pickup control here can be the information of carrying in the control signal, also can be the information that this locality sets in advance.
Optionally, when information that includes the control of startup pickup in the control signal and pickup control duration, can be according to adjust the conversion process operation of carrying out pickup zone adjusting parameter that step-length information continues in pickup control duration, up to reaching pickup control duration, perhaps include the control signal that stops the pickup control information, thereby parameter is regulated in a plurality of pickups of the generation that can continue zone up to receiving.The adjustment step-length information of the pickup control here can be the information of carrying in the control signal, also can be the information that this locality sets in advance.
Optionally, when the information that includes the control of startup pickup in the control signal and pickup control number of times such as n (n is the integer greater than 0), can carry out the conversion process operation that n time parameter is regulated in the pickup zone according to adjusting step-length information, regulate parameter thereby can produce n pickup zone.The conversion process operation of regulating parameter in the pickup zone does not also reach n time but receives and includes the control signal that stops the pickup control information, then can no longer carry out follow-up conversion process operation.The adjustment step-length information of the pickup control here can be the information of carrying in the control signal, also can be the information that this locality sets in advance.
Optionally, when including target pickup area information in the control signal, can obtain the pickup zone according to the target pickup area information in this control signal and regulate parameter.
Optionally, in control signal, include the information that starts pickup control, but when not comprising information such as pickup control duration, target pickup area information and pickup control number of times, can include the control signal that stops the pickup control information up to receiving according to adjusting the conversion process operation of carrying out pickup zone adjusting parameter that step-length information continues.In addition, also can only carry out a regional conversion process operation of regulating parameter of pickup according to adjusting step-length information, rather than the conversion process operation of carrying out pickup zone adjusting parameter that continues.The adjustment step-length information of the pickup control here can be the information of carrying in the control signal, also can be the information that this locality sets in advance.
Parameter is regulated in the pickup zone can have multiple different form according to the difference of regulating pick up facility pickup domain mode.The content that adjusting parameter in pickup zone is comprised is enumerated explanation below.
Example 1, the method that adopts signal to synthesize are regulated pick up facility pickup zone: phase place and amplitude to a plurality of microphone picked up audio signals are handled, produce composite signal, parameter is regulated in the pickup zone can comprise that the amplitude of each microphone correspondence adjusts the weighted value of parameter and adjust the delay parameter of parameter for the phase place of the correspondence of each microphone picked up audio signals.Should be provided with a plurality of microphones in the pick up facility this moment.
Example 2, employing mechanical regulation method are regulated pick up facility pickup zone side: promptly the included microphone of pick up facility this moment has corresponding physics barrier structure respectively, this physics barrier structure is used for the pickup angle of this microphone is regulated, promptly block, make the zone of microphone picked up audio signals change by the physical location (orientation) of regulating microphone and/or the physics of regulating the microphone pickup.Can be provided with one or more microphones in the pick up facility this moment.
Example 3, adopt the synthetic and mechanical adjustment of signal in conjunction with regulating pick up facility pickup zone: pickup orientation and pickup angle (scope) part are by above-mentioned signal synthesis method adjustment, and part adopts above-mentioned mechanical regulation method adjustment.As the The Cloud Terrace adjustment mechanically of pickup orientation, the pickup angle is adjusted by the synthetic wave beam formation method of signal.
Example 4, regulate pick up facility pickup zone: utilize the auditory localization algorithm to determine whether sound source is positioned at the pickup zone of setting by sound localization method, if sound source is positioned at the pickup zone of setting, then control microphone pickup and output audio signal, if sound source is positioned at outside the pickup zone, do not carry out the pickup of audio signal or pick up this audio signal even then control microphone, but above-mentioned audio signal is not exported.Auditory localization can be adopted TDOA (Time Difference of Arrivals, arrive time delay) technology, this technology adopts the different microphone in a plurality of positions, obtain the time delay that sound arrives the diverse location microphone, try to achieve the range difference that sound arrives the diverse location microphone utilizing these time delays, determine sound source position with geometrical relationship or search at last, this method is to be widely used a kind of in the auditory localization technology, specific implementation repeats no more, be appreciated that those of ordinary skill in the art passes through the instruction and the inspiration of TDOA technology, it will also be appreciated that other auditory localization algorithm, to this, embodiments of the invention do not limit.
Above-mentionedly enumerate 4 examples of regulating pick up facility pickup domain modes and can use separately, also can applied in any combination, corresponding, above-mentionedly enumerate 4 pickups zones and regulate parameters and comprise that the example of parameter information can use separately, also can applied in any combination.
Because the difference that parameter comprises parameter information is regulated in the pickup zone, the specific implementation process that control signal is converted to the pickup zone adjusting parameter in target pickup zone also can be different, concrete transfer process has detailed example record in the following embodiments, no longer describes in detail at this.No matter conversion process is a specific implementation how, it should be that parameter is regulated in corresponding pickup zone, target pickup zone that parameter is regulated in pickup zone after the conversion, and promptly conversion principle is: parameter is regulated in the pickup zone after the conversion should make the target pickup zone corresponding with control signal, pickup zone of pick up facility conform to substantially.
S320, regulate parameter according to described pickup zone at least one microphone in the described pick up facility is carried out pickup control, thereby the pickup zone of the audio signal correspondence of pick up facility output is conformed to target pickup zone.
After promptly carrying out pickup control, pick up facility carries out pickup at target pickup zone.
First concrete example of the pickup of S320 control is: the phase place and the amplitude of regulating the audio signal that weighted value in the parameter and delay parameter pick up and export each microphone in the pick up facility according to the pickup zone in target pickup zone are adjusted, and do not belong to the audio signal in target pickup zone with filtering.
Need to prove that above-mentioned utilize amplitude adjustment parameter and phase place are adjusted the adjustment that parameter is carried out microphone, can carry out at the single microphone of pick up facility, also can carry out at a plurality of microphones of pick up facility.Wherein, single microphone at pick up facility is controlled, adjust the amplitude of the picked up audio signals of this microphone by weighted value, adjust the phase place of this microphone institute picked up audio signals by delay parameter, the audio signal that this microphone after adjusting is collected is synthesized with the signal of other microphone collections and is obtained the audio signal that final pick up facility is exported; When above-mentioned control signal is that a plurality of microphones at pick up facility are when carrying out pickup control, the weighted value of the correspondence by microphone to be adjusted is adjusted the amplitude of described microphone picked up audio signals to be adjusted, delay parameter by microphone correspondence to be adjusted is adjusted the phase place of described microphone picked up audio signals to be adjusted, the audio signal of above-mentioned adjusted each microphone is synthesized the audio signal that obtains final pick up facility output.
Need to prove, microphone is carried out audio signal to carry out after amplitude and/or phase place adjust, need the signal that each microphone in the pick up facility picks up be synthesized, it has been prior art that each microphone is carried out the signal synthetic technology, no longer gives unnecessary details at this.
Second concrete example of the pickup control of S320 is: the shift position parameter adjustment microphone shelter of the microphone pickup angle correspondence in the parameter and the relative position of microphone are regulated in the pickup zone according to target pickup zone, position as mobile shelter, the position of mobile microphone for another example, also has the position of mobile shelter and microphone.
The 3rd concrete example of the pickup control of S320 is: the position adjustments parameter of regulating the microphone place The Cloud Terrace in the parameter according to the pickup zone in target pickup zone is carried out the adjustment of level and/or pitch position to microphone place The Cloud Terrace.
The 4th concrete example of the pickup of S320 control is: the parameter of regulating the whether pickup in the parameter according to the pickup zone in target pickup zone judges that the parameter of the whether pickup of each microphone correspondence is that pickup also is non-pickup, if a microphone corresponding parameters is a pickup, then control this microphone and pick up audio signal and output, promptly can obtain this microphone picked up audio signals; If a microphone corresponding parameters is non-pickup, then can control this microphone and not pick up audio signal, perhaps do not accept this microphone picked up audio signals.
Above-mentioned four object lessons of enumerating among the S320 can be used separately, also can combination in any use.
Of particular note, in the foregoing description one the execution flow process of S310 and S320 can for: produce pickup zone and regulate parameter, carries out a pickup control, then, produce a pickup zone again and regulate parameter, carry out a pickup again and control.The execution flow process of S310 and S320 also can for: carry out pickup control successively producing the generation order of regulating parameter according to the pickup zone again after parameter is regulated in a plurality of pickups zone, in this execution flow process, if receive the control signal that stops pickup control, regulate parameter even if also have one or more pickup zones that produced but also do not had to use, also no longer carry out S320.
Optionally, after having carried out S320, can comprise: the gain to the synthetic audio signal afterwards of each microphone is adjusted.Described gain increases along with the reducing of pickup angle of described pick up facility.Can adopt existing gain to adjust implementation to the gain adjustment of audio signal, present embodiment is the specific implementation process of limiting gain adjustment not.
In addition, optionally, after having carried out S320, can also comprise: return the current pickup area information of pick up facility after pickup control to control terminal, this current pickup area information can be represented with the form of beam pattern, also can represent with forms such as orientation angles and pickup angle numerical value.A concrete example is: regulate in the application scenarios of parameter continue producing a plurality of pickups zone, whenever regulate after parameter carries out pickup control according to a pickup zone, all return corresponding beam pattern to control terminal.The control terminal here can be the network equipment that is connected with pick up facility by network interface, also can be the network equipment that is connected with pick up facility by local interface.The control terminal here can for send P/T/Z (Pan/Tilt/Zoom, promptly comprehensive (comprising: up and down, about) move and before and after control) network equipment of control signal.
From the description of the foregoing description one as can be known, the pick-up control method of embodiment one can be realized pickup control to the microphone in the pick up facility by the PTZ control signal and to the conversion process of PTZ control signal, because the PTZ control signal can be by network interface and local control interface transmission, therefore, embodiment one can realize the far-end control of pickup, is fit to be applied in the application scenarios such as video conference.The adjustment of the relative position by adopting weighted value, microphone and shelter, the horizontal and vertical position of The Cloud Terrace and whether multiple mode such as pickup microphone is carried out pickup control, not only can realize the pickup control of horizontal direction, vertical direction and angle, make the pickup control mode of pick up facility more flexible, and can carry out careful accurate control the pickup of microphone.In addition, the pick-up control method of embodiment one can well be applicable in multichannel or the monaural pick up facility.
Be that example is illustrated pick-up control method of the present invention with several concrete implementation procedures below.Because following each embodiment all has the emphasis of description, therefore, following each embodiment is applied in any combination optionally.Specific implementation process for a lot of applied in any combination no longer describes in detail.
Embodiment two, carry out pick-up control method based on the synthetic mode of signal.The principle of the pick-up control method of forming method generation of employing fixed beam and output audio signal as shown in Figure 4.
In Fig. 4, pick up facility is provided with m microphone, and m microphone output m road audio signal omitted among Fig. 4 and shown the 3 the road to m-1 road audio signal.The audio signal Y (t) of pick up facility output can be expressed as form:
Y ( t ) = Σ i = 1 m w i × X i ( t - τ i ) Formula (1)
Wherein, X iBe i road microphone picked up audio signals, or perhaps the i road input signal of pick up facility, Y is the audio signal of pick up facility output, w iBe the weighted value that distributes at i road audio signal, m is the number of microphone in the pick up facility, τ iBe to adjust parameter at the delay that i road microphone is provided with.
At the pickup control procedure of Fig. 4 can for: receive the PTZ control signal, the PTZ control signal be converted to above-mentioned weighted value w iWith delay parameter τ i, then, according to the weighted value w after the conversion iWith delay parameter τ iUtilize formula (1) to the generation composite signal, thus the audio signal output that acquisition conforms to target pickup zone.The above-mentioned PTZ control signal that receives can include the adjusting information of adjusting information, pitch orientation of horizontal direction and pickup angular adjustment information etc.The PTZ control signal is converted to weighted value w iWith delay parameter τ iThe specific implementation process detailed illustrating arranged in the following embodiments.
The pick-up control method of embodiment three, the adjusting step-length that pre-sets based on the employing of weighted value.Be controlled to be under the situation of microphone being carried out Z (zoom) adjusting in the pickup that the microphone to pick up facility carries out, the flow process of this method is shown in accompanying drawing 5A.
Among Fig. 5 A, S500, receive and start the Zoom regulating command,
Receive to include by network interface or local control interface and carry out the PTZ control signal that ZOOM regulates.The PTZ control signal of this moment is called startup ZOOM regulating command.Optionally, after receiving startup ZOOM regulating command, can start timer at the ZOOM regulating command, the timing length of this timer can obtain from start the ZOOM regulating command, also can obtain the canned data in advance, as adopt default timing length from this locality.
S510, regulate step delta Z according to the current pickup angle Z of pick up facility microphone and the ZOOM that pre-sets and calculate the pickup angle that the microphone needs are adjusted to.The pickup angle that microphone need be adjusted to is the corresponding pickup angle in target pickup zone.The pickup angle that microphone need be adjusted to is 2 φ, and 2 φ=Z ± Δ Z.
S520, calculate the weighted value w of each microphone in the pick up facility based on φ i, for example, utilize φ and other calculation of parameter to go out the weighted value w of each microphone in the pick up facility i, other parameters here can be array microphone geometric parameter, thresholding ρ and some other constraints (specifically referring to embodiment) etc.
S530, use w iAudio signal to each microphone output of pick up facility is handled, the audio signal that the target pickup zone put down in writing among pick up facility output and the above-mentioned S510 is conformed to.
S540, the current pickup angle Z of pick up facility microphone is adjusted into 2 φ.
S550, judge whether to receive and include the PTZ control signal that stops the pickup control information by network interface or local control interface, including the PTZ control signal that stops the pickup control information can be called and stop the ZOOM regulating command, stop the ZOOM regulating command if receive, then arrive S560, otherwise, to S510, continue to carry out the adjusting of pickup angle at microphone.
Optionally, if in S500, started timer, should judge also in S550 then whether timer is overtime, no matter receives to stop ZOOM regulating command or timer expiry, then all required S560.
Optionally, after S530 or S540 or S550 or S560, can also comprise: return the beam pattern information of carrying out after ZOOM regulates to control terminal, like this, control terminal can know that following ZOOM regulates the beam pattern that changes, thereby control terminal can be judged the pickup control that whether has realized its needs according to the beam pattern that returns, after judging pickup control that has realized its needs, control terminal can send and stop the ZOOM regulating command.Certainly, above-mentioned beam pattern information also can replace with forms such as ZOOM numerical value.
S560, termination are regulated at the ZOOM of microphone.
In embodiment three, pick up facility can be provided with one or more microphones.As an example, be provided with in pick up facility under the situation of 5 microphones, the distribution of these 5 microphones can be shown in accompanying drawing 5B.The distribution of the microphone 1 among Fig. 5 B, microphone 3, microphone 4 and microphone 5 is square, and microphone 2 is positioned at foursquare center, and the arranged outside of 5 microphones has shelter--sleeve.Sleeve can move along the normal direction on plane, 5 microphone places.Though among Fig. 5 B sleeve has been shown, but the flow process shown in Fig. 5 A is not adjusted the relative position of microphone and sleeve, adjust the relative position of microphone and sleeve if desired, S520 among then above-mentioned Fig. 5 A and S530 can replace with the relative position of adjusting microphone and sleeve, for example, sleeve moves along the normal direction on plane, microphone place, because sleeve to the scope of blocking in microphone pickup zone change has taken place, therefore, the pickup angle of microphone also can change thereupon.It also is same that microphone is moved.
The foregoing description three is adjusted to example with Z and describes, P (level, promptly) regulate and the specific implementation process of specific implementation process that T (pitching, also promptly vertical up and down) regulates and above-mentioned Z adjusting basic identical, the foregoing description is to be with to weight w with adjusting in addition iAdjusting describe, also be similar process to the adjusting of delay, The Cloud Terrace etc., in embodiment three, no longer describe in detail.
Embodiment four, based on the pick-up control method of weighted value.The present embodiment microphone distribution situation emphasis shown in the 5B is in conjunction with the accompanying drawings described the specific implementation process of determining the pickup zone adjusting parameter in target pickup zone according to the PTZ control signal.
The PTZ control signal that setting receives is to carry out the PTZ control signal that pickup is controlled respectively at the P of microphone and T.
To simplify the analysis, respectively level and vertical direction are calculated, when the P at pick up facility carries out pickup control, be reduced to a linear microphone array, adopt plane wave model, as shown in Figure 6, target source of sound and center microphone are that the line of microphone 2 and the angle of microphone array normal direction are θ, if normal direction is the initial position of former source of sound, then θ is the P deflection angle that microphone need carry out pickup control.
Set sound wave (the being audio signal) X that microphone i (i=1,2,3) receives i(t) be expressed as with complex exponential form:
X i(t)=e J ω (t-(i-1) d sin θ/c)=e J[ω t-2 π (i-1) d/ λ]Formula (2)
Wherein, ω is the angular speed of sound wave, and λ is the wavelength of sound wave, and c is the sound wave transmission speed, and d is array element distance (distance between the microphone), and the amplitude equivalence is 1.T is the time.
Setting
Figure GSA00000008463200141
Situation under, above-mentioned formula (2) can be changed to:
X i(t)=e J[ω t-(i-1) α]Formula (3)
At this moment, the audio signal of pick up facility output is that composite signal is:
Y ( t ) = Σ i = 1 3 w i × X i ( t ) × e - jω τ i
= Σ i = 1 3 w i e jωt e - j [ ( i - 1 ) α + ω τ i ]
= w 1 e - jω τ 1 e jωt + w 2 e - j ( α + ω τ 2 ) e jωt + w 3 e - j ( 2 α + ω τ 3 ) e jωt Formula (4)
In order to make composite signal, need make along θ angular direction maximum (the amplitude maximum of composite signal) When i gets different numerical value, all equate, simultaneously, when the pickup of carrying out vertical direction at microphone is controlled, influence microphone 2, need be with delay parameter τ 2Be set to 0, therefore can get:
ω τ 1 = 2 kπ + α τ 2 = 0 2 α + ω τ 3 = 2 nπ + α Formula (5)
Wherein, k and n are arbitrary integer.
If set k=n=0, then can obtain one group of design of each pick up facility delay parameter:
τ 1 τ 2 τ 3 = d sin θ / c 0 - d sin θ / c (6)
Similarly, after pitching (T) the pickup angle of adjusting pick up facility is η, can obtain:
τ 4 τ 2 τ 5 = d sin η / c 0 - d sin η / c Formula (7)
Wherein, d can design according to the restraint condition of reality, and for example according to the bulk restrictive condition design d of reality, the value of d can be 0.2m.
Only need just can regulate pickup direction, w in this example by postponing control iCan design according to actual conditions, for example, w iValue can be 1/m, wherein, m is the quantity of microphone, under the situation of 5 microphones, w iCan be 1/5.
From the description of the foregoing description four as can be known, after the PTZ control signal that receives with θ and rotation of η corresponding horizontal and pitch regulation, obtain the delay parameter τ of each the microphone correspondence after the PTZ control signal is changed according to the method for the foregoing description four records 1~τ 5And weighted value w i(value of i is 1 to 5) afterwards, utilizes τ 1~τ 5And w iEach microphone picked up audio signals is handled, can be obtained the audio signal that conforms to substantially with the pickup zone of expecting (target pickup zone).
Embodiment five, utilize the rotation control mechanism of machinery to carry out pitching and/or horizontally rotate and the mode of weighted value realizes the method for pickup control.In the present embodiment, be that mechanical rotation control mechanism is that example describes pick-up control method with the The Cloud Terrace.
The Cloud Terrace shown in Fig. 7 A is provided with 5 microphones, and The Cloud Terrace can carry out moving of level and vertical direction by Stepping Motor Control, and then has changed the pickup orientation of microphone.
The pickup angle of microphone also can be adjusted among the embodiment five, for example, picks up the delay parameter and the weighted value of audio signal by the control microphone pickup angle of microphone is adjusted; Again for example, by the gain of control microphone picked up audio signals the pickup angle of microphone is adjusted.Mainly the adjustment of microphone pickup angle (ZOOM) is elaborated below.
Pickup control at the horizontal direction of the ZOOM of microphone is as follows:
Because The Cloud Terrace can rotate, therefore, the azimuthal adjustment of microphone can realize that therefore for array microphone, can be considered as θ is 0 by The Cloud Terrace, therefore, and the phase delay parameter τ of microphone i=0, for the sound wave that becomes arbitrarily angled δ with normal, its composite signal is:
Y ( t ) = Σ i = 1 3 w i e jωt e - j [ ( i - 1 ) α ( δ ) ]
= w 1 e jωt + w 2 e - jα ( δ ) e jωt + w 3 e - j ( 2 α ( δ ) ) e jω
= ( w 1 e jα ( δ ) + w 2 + w 3 e - jα ( δ ) ) e - jα ( δ ) e jωt Formula (8)
The amplitude of composite signal square is:
| Y ( t ) | 2 = | ( w 1 e jα ( δ ) + w 2 + w 3 e - jα ( δ ) ) e - jα ( δ ) e jωt | 2
= [ w 1 cos ( α ( δ ) ) + w 2 + w 3 cos ( - α ( δ ) ) ] 2 + [ w 1 sin ( α ( δ ) ) + w 3 sin ( - ( α ( δ ) ) ) ] 2
= [ ( w 1 + w 3 ) cos ( α ( δ ) ) + w 2 ] 2 + [ ( w 1 - w 3 ) sin ( α ( δ ) ) ] 2
= [ ( w 1 + w 3 ) cos ( 2 πd λ ( sin ( δ ) ) ) + w 2 ] 2 + [ ( w 1 - w 3 ) sin ( 2 πd λ ( sin ( δ ) ) ) ] 2 Formula (9)
Be simplified design, can make w 1=w 3, then have
| Y ( t ) | = | 2 w 1 cos ( 2 πd λ ( sin ( δ ) ) ) + w 2 | = | 2 w 1 f ( δ ) + w 2 | , Wherein f ( δ ) = cos ( 2 πd λ sin ( δ ) ) Formula (10)
When carrying out the ZOOM adjusting, shown in accompanying drawing 7B, the pickup angle that is equivalent to the pick up facility adjustment is 2 φ, (border when sound source is positioned at pickup angle φ orientation, be two rays of representing with solid line among Fig. 7 B), the amplitude fading of composite signal is to ρ (0<ρ<1) times of normal direction (δ=0) amplitude, that is:
Figure GSA00000008463200167
Formula (11)
(1) in the use formula (11) can get:
w 2 w 1 = 2 ( ρ - f ( φ ) ) 1 - ρ ... ... ... .... as (2w 1F (φ)+w 2)>0 formula (12)
Set w 1And w 2Greater than 0, then can get by (1) in the formula (11)
F (φ)<ρ ... ... ... .... as (2w 1F (φ)+w 2)>0 formula (13)
In order to make δ exist
Figure GSA00000008463200169
In the scope during value, | Y (t) | can monotone variation, need make
Figure GSA000000084632001610
Figure GSA000000084632001611
Reindexing not in respective bins, thus have
Figure GSA000000084632001612
The span that convolution (13) can obtain φ is constrained to:
arccos ( ρ ) ≤ 2 πd λ sin ( φ ) ≤ π Formula (14)
The maximum of setting φ is φ Max, minimum value is φ Min, then have:
d λ ≤ 1 2 sin ( φ max ) φ min ≥ arcsin ( arccos ( ρ ) × λ 2 πd ) , d λ ≥ arccos ( ρ ) 2 π Formula (15)
Because under the arrowband situation, λ is known, therefore, can determine the parameter of array microphone
Figure GSA00000008463200172
Engineering for the ease of array microphone is made the span that can obtain bigger φ, and d can select higher value, for example
Figure GSA00000008463200173
Certainly, d also can select to satisfy
Figure GSA00000008463200174
Other values of condition.
If to w iFurther impose restriction, then can obtain w iA concrete example that imposes restriction is: condition ∑ w is set i=C.
By as above describing as can be known, one group of design of the relevant parameter of the microphone in the pick up facility can be expressed as form:
Figure GSA00000008463200175
Formula (16)
As ∑ w iDuring=C, have
Figure GSA00000008463200181
Formula (17)
When d = λ 2 sin φ max The time, have
Figure GSA00000008463200183
Formula (18)
Be a concrete design example of the relevant parameter of the microphone in the pick up facility below:
Set
Figure GSA00000008463200185
C=1, λ=0.1m,
Figure GSA00000008463200186
Then the relevant parameter of the microphone in the pick up facility is:
Figure GSA00000008463200191
Formula (19)
The composite signal of pick up facility output is:
| Y ( t ) | = 2 w 1 cos ( 2 πd λ sin ( δ ) ) w 2 = 0.272 cos ( 3.63 sin δ ) + 0.728 . Formula (20)
If with
Figure GSA00000008463200193
Be polar angle, with | Y (t) | be utmost point footpath, then can be shown in accompanying drawing 7C at the beam pattern that draws in the polar coordinate system.
From the beam pattern shown in Fig. 7 C as can be seen, spend to 360 degree (back side that is equivalent to pick up facility) 180 and can pick up audio signal yet, the back side that in actual applications can be by blocking pick up facility or the back side of hypothesis pick up facility do not have source of sound to avoid the influence of the audio signal of picking up from the back side.
If adopt and control similar mode at the pickup of the horizontal direction of the ZOOM of microphone and design at the pickup control of the vertical direction of the ZOOM of microphone, then one of the relevant parameter of the microphone in the pick up facility group of design can for:
τ i = 0 d = λ 2 sin φ max w 4 = C ( 1 - ρ ) 2 [ 1 - f ( φ ) ] w 2 = C [ ρ - f ( φ ) ] 1 - f ( φ ) w 5 = C ( 1 - ρ ) 2 [ 1 - f ( φ ) ] Formula (21)
In embodiment five, because P and T adjust by The Cloud Terrace, and ZOOM adjusts by weighted value, therefore, after receiving the PTZ control signal, the PTZ control signal should be converted to PT regulating command and Z regulating command, use the PT regulating command to control moving of The Cloud Terrace, use the Z regulating command to control the ZOOM of microphone.PT regulating command such as level are regulated predetermined step-length, level left and are regulated predetermined step-length, pitching to the right to regulate predetermined step-length and pitching downwards long etc. to the adjusted predetermined steps.Above-mentioned PT regulating command and Z regulating command all belong to the pickup zone in target pickup zone and regulate parameter.
Pick up facility for multi-microphone more (m=2k+1) is formed can be easy to set up more general equation and find the solution:
Be provided with m=2k+1 microphone, numbering i is respectively-k ... 0 ... k, wherein the 0th is middle microphone, spacing is d between the microphone
| Y ( φ ) | = | Σ i = - k k w i e - j [ ( i - 1 ) α ( φ ) ] | | Y ( φ ) | = ρ Σ i = - k k w i Formula (22)
Can according to circumstances increase various constraint solvings for following formula, provide a kind of method for solving below:
Make w i=w -iCan obtain:
| Y ( φ ) | = | 2 Σ i = 1 k ( w i cos ( i 2 πd λ ( sin ( φ ) ) ) ) + w 0 | = | 2 Σ i = 1 k ( w i f i ( φ ) w 0 ) | , Wherein f i ( φ ) = cos ( i 2 πd λ sin ( φ ) ) Formula (23)
Order w i = w 1 , i = 1 . . . k Σ i = - k k w i = C
With reference to finding the solution of front 3 microphones, can solve:
w 0 = C ( kρ - F ( φ ) ) k - F ( φ ) w i = C ( 1 - ρ ) 2 ( k - F ( φ ) ) , i ≠ 0 , Wherein F ( φ ) = Σ i = 1 k cos ( i 2 πd λ sin ( φ ) )
Formula (24)
Similarly can try to achieve a conservative span
d ≤ λ 2 k sin φ max Formula (25)
Embodiment six, the pick-up control method that synthesizes based on signal fully.
In embodiment six, a plurality of microphones that pick up facility comprises not at grade, the distribution shape of a plurality of microphones is rib vertebra shape.A concrete distribution example is: the microphone 2 in 5 microphones shown in Fig. 5 B is not in same plane with other four microphones, and at this moment, can form one is the bottom surface with microphone 1,3,4 and 5, is the four rib vertebras on summit with microphone 2.Before microphone 2 is protruded in the plane at other microphone places, microphone 1,2 and 3 and the position of source of sound relation shown in accompanying drawing 8A.
Among Fig. 8 A, microphone 1,2 and 3 constitutes an equilateral triangle, and θ is the angle between source of sound and the horizontal line, rather than the angle between source of sound and the normal, and corresponding, pickup level (P) the direction deflection angle of adjusting is
Figure GSA00000008463200211
Below in conjunction with accompanying drawing 8A the pickup control of horizontal direction is described.
The composite signal of pick up facility can be expressed as:
Y ( t ) = Σ i = 1 3 w i × X i ( t ) × e - jω τ i
= w 1 e - j ( ω τ 1 + 2 πd λ cos ( π 3 - θ ) ) e jωt + w 2 e - jω τ 2 e jωt + w 3 e - j ( ω τ 3 + 2 πd λ cos ( 2 π 3 - θ ) ) e jωt Formula (26)
In order to make composite signal along θ angular direction maximum, promptly, need make the phase place of composite signal identical in order to make the amplitude maximum of composite signal along the θ angular direction, formula (26) wherein one group separate into:
ω ( τ 1 + 2 πd λ cos ( π 3 - θ ) ) = 0 ω τ 2 = 0 ω ( τ 3 + 2 πd λ cos ( 2 π 3 - θ ) ) = 0 ⇒ τ 1 = - 2 πd λ cos ( π 3 - θ ) τ 2 = 0 τ 3 = - 2 πd λ cos ( 2 π 3 - θ ) Formula (27)
In order to make τ i〉=0, increase a unified retardation can for all delayers, or increase one-period for some delayer (being certain delay parameter) Do not influence the composite signal of output.
Similar with the pickup control of horizontal direction, after the pickup angle of adjusting pitching (T) is η, can obtain:
τ 4 = - 2 πd λ cos ( π 3 - η ) τ 2 = 0 τ 5 = - 2 πd λ cos ( 2 π 3 - η ) Formula (28)
Regulate to determine weight parameter according to ZOOM wProcess be:
For become with the θ direction (sound wave at angle of δ-θ), the composite signal of pick up facility can be expressed as:
Y ( t ) = Σ i = 1 3 w i × X i ( t ) × e - jω τ i
= w 1 e - j 2 πd λ cos ( π 3 - δ ) e jωt e j 2 πd λ cos ( π 3 - θ ) + w 2 e jωt + w 3 e - j 2 πd λ cos ( 2 π 3 - δ ) e jωt e j 2 πd λ cos ( 2 π 3 - θ )
= | w 1 e - j 2 πd λ cos ( π 3 - δ ) e j 2 πd λ cos ( π 3 - θ ) + w 2 + w 3 e - j 2 πd λ cos ( 2 π 3 - δ ) e j 2 πd λ cos ( 2 π 3 - θ ) |
= | w 1 e j 2 πd λ ( cos ( π 3 - θ ) - cos ( π 3 - δ ) ) + w 2 + w 3 e j 2 πd λ ( cos ( 2 π 3 - θ ) - cos ( 2 π 3 - δ ) ) | Formula (29)
According to formula (29) as can be known, for given pickup orientation θ and pickup angular range 2 φ, set when sound source is positioned at pickup angle φ orientation (δ=θ ± φ), the amplitude fading of composite signal to normal direction (δ=θ) ρ of amplitude (0<ρ<1) times, that is:
| Y (θ ± φ) |=ρ | Y (θ) |=α (w 1+ w 2+ w 3) ... .... (5) formula (30)
Utilize (5) in the formula (30) can find the solution w i, solving result is not unique, can find the solution this constraints such as ∑ w again by increasing some constraintss i=C etc.
At w iUnder>0 the situation, set
Figure GSA00000008463200226
Figure GSA00000008463200227
Figure GSA00000008463200228
Figure GSA00000008463200229
C=1 then can get:
| w 1 e j 2 π ( cos ( π 12 ) - cos ( - π 12 ) ) + w 2 + w 3 e j 2 π ( cos ( 5 π 12 ) - cos ( π 4 ) ) | = 1 2 ( w 1 + w 2 + w 3 ) | w 1 e j 2 π ( cos ( π 12 ) - cos ( π 4 ) ) + w 2 + w 3 e j 2 π ( 2 cos ( 5 π 12 ) ) | = 1 2 ( w 1 + w 2 + w 3 ) ⇒
| w 1 + w 2 + w 3 e - j 0.8966 π | = 1 2 ( w 1 + w 2 + w 3 ) | w 1 e j 0.5176 π + w 2 + w 3 e j 1.0353 π | = 1 2 ( w 1 + w 2 + w 3 ) ⇒
( w 1 + w 2 + w 3 cos ( - 0.8966 π ) ) 2 + ( w 3 sin ( - 0.8966 π ) ) 2 = 1 2 ( w 1 + w 2 + w 3 ) ( w 1 cos ( 0.5176 π ) + w 2 + w 3 cos ( 1.0353 π ) ) 2 + ( w 1 sin ( 0.5176 π ) + w 3 sin ( 1.0353 π ) ) 2 = 1 2 ( w 1 + w 2 + w 3 ) ⇒
( w 1 + w 2 - 0.9477 w 3 ) 2 + ( - 0.319 2 w 3 ) 2 = 1 2 ( w 1 + w 2 + w 3 ) ( - 0.0553 w 1 + w 2 - 0.9939 w 3 ) 2 + ( 0.998472 w 1 - 0.11067 w 3 ) 2 = 1 2 ( w 1 + w 2 + w 3 ) w 1 + w 2 + w 3 = 1
Can obtain thus a group of w separate into:
Figure GSA00000008463200235
Corresponding at this moment beam pattern is shown in accompanying drawing 8B.
From the beam pattern shown in Fig. 8 B as can be seen, near some directions beyond target pickup zone (degree of 330 among Fig. 8 B) have bigger gain, in actual applications, can suppose or arrange that these zones do not have source of sound to avoid influencing target pickup zone.In addition, also can increase the number of microphone in the pick up facility, thereby effectively eliminate the influence of secondary lobe, increase number of microphone as the equilateral triangle among the figure is transformed to square or pentagon or the like.
Need to prove that the PTZ control in the embodiment of the invention is in order the describing mode of a kind of pickup Region control embodiment that the present invention adopts to be described better, also to have other control mode existence that to this, the present invention does not limit.
Embodiment seven, based on the pick-up control method of auditory localization technology.
At first, determine the sound bearing by the auditory localization algorithm, then, judge whether the sound bearing drops in the pickup zone of microphone, if drop in the pickup zone of microphone, then control microphone and carry out pickup, otherwise the control microphone does not carry out pickup or do not receive this microphone picked up audio signals.That is to say, choose the microphone that the pickup zone comprises the sound bearing, the microphone picked up audio signals that includes the sound bearing at the pickup zone is handled.
Carry out following some explanation at the foregoing description below:
Illustrate 1, can adopt several different methods to form wave beam in the various embodiments described above, for example, adopt adaptive beam forming method etc.The various embodiments described above go for the pickup control of narrow band signal, also go for the pickup control of broadband signal.For broadband signal, can adopt subband wave beam forming method, and can adopt from multiple modes such as pickup wave beam forming methods at each subband and to form wave beam.
Illustrate 2, mostly the various embodiments described above be with 5 microphones to be that example is described, and can adopt the microphone of greater number in actual applications, to reach better pickup control effect.
Illustrate 3, when the pickup zone of microphone hour, higher signal to noise ratio is arranged, promptly therefore much noise, can also carry out synchronous gain controlling to microphone corresponding audio signal, to embody near big and far smaller sensation outside the pickup zone.In actual design, also can directly make ∑ w i=C increases along with pickup zone 2 reducing of φ, for example, and order
Figure GSA00000008463200241
K wherein is a proportionality constant.
In addition, the also Position Control that can present by sound, make the sound source position present reducing and become near with pickup zone 2 φ, make voice output embody the sensation that sound furthers, for example, the positional information after target pickup area information or the conversion can be passed to the output of audio frequency apparatus, cooperate by output and realize pickup control, for example, adopt array speaker to make the sound source position of reproduction change.
Illustrate 3, in the various embodiments described above, sound can be picked as a setting to specify the outer sound in pickup zone (being target pickup zone), can change the audio signal in target pickup zone and the proportion of background sound by the value of adjusting ρ.Wishing can to get bigger ρ value under the outstanding more situation of background sound, the sound in the outstanding target pickup zone of hope, and background sound is carried out under the situation of more filterings, can get less ρ value.A concrete example is: in embodiment three, if ρ=0.2, then Dui Ying beam pattern as shown in Figure 9; If ρ=0.7, then Dui Ying beam pattern as shown in Figure 10.
Illustrate 4, in the above-described embodiments, pick up facility can be provided with and be specifically designed to the microphone that picks up background sound, as is specifically designed to the omnidirectional microphone that picks up background sound.Can attenuation coefficient be set for being specifically designed to the microphone that picks up background sound, after the background sound that picks up being decayed according to attenuation coefficient, the composite signal stack output that the background sound after will decaying again is corresponding with other microphones.
Illustrate 5, in the above-described embodiments, use The Cloud Terrace if desired, then this The Cloud Terrace can be the The Cloud Terrace of microphone special use, also can be microphone and the shared The Cloud Terrace of camera.When microphone and the shared The Cloud Terrace of camera, can realize making a video recording and the Synchronization Control of pickup.The situation of microphone and the shared The Cloud Terrace of camera can be as shown in Figure 11.Be connected with a camera and five microphones on the The Cloud Terrace in Figure 11, five microphones are the numbering 1 to 5 that marks among Figure 11.When The Cloud Terrace level or pitching were moved, the pickup zone of the camera watch region of camera and microphone all changed simultaneously.After receiving the PTZ control signal by network interface or local control interface, the PTZ control signal can be converted to PT regulating command and ZOOM regulating command, use moving of PT regulating command control The Cloud Terrace, use the ZOOM regulating command that make a video recording control and pickup of camera and microphone controlled.In addition, can also use the shelter of microphone among Figure 11, like this, the ZOOM regulating command can be used to regulate the relative position of shelter and microphone.
Illustrate 6, in the above-described embodiments, be PTZ control signal design FMCC (Fast MicrophoneControl Criteria, the Remote Camera control command) agreement, FMCC order can be by H.224 passage carryings, also can directly be carried in the message such as TCP/UDP.Shown in following each table of a concrete example of FMCC order:
Table 1
Figure GSA00000008463200251
FMCC order in the table 1 comprises N byte, and each byte comprises 8bit, corresponding 1 byte of each row of promptly showing, and first byte (command) is a command word, and second byte (device) is a device id, and the value of second byte can be 0~255.Be provided with a plurality of controlled pick up facilities in an equipment, during as a plurality of controlled microphone, can distinguish controlled pick up facility by device id, when only being provided with a controlled pick up facility in the equipment, second byte can not define.All the other bytes except that first byte and second byte are parameter, and different command word corresponding parameters also can be different, and promptly the parameter of different command can be different.The definition of the command word in the table 1 is as shown in table 2:
Table 2
The Command title Value Implication
Start?action 0xf1 Starting PTZ adjusts
Continue?action 0xf2 Continuing PTZ adjusts
Stop?action 0xf3 Stopping PTZ adjusting
Store?preset 0xf4 Storage PTZ position
Activate?preset 0xf5 The activation position that prestores
Set?threshold 0xf6 Pickup zone threshold values is set
Send?beam?pattern 0xe1 Send digital beam figure
Having defined 6 kinds of FMCC order in the table 2, is respectively to start FMCC order that PTZ adjusts, continue FMCC order that PTZ adjusts, stop FMCC order that PTZ adjusting, the FMCC order of storage PTZ position, activate the FMCC order of the position that prestores and send the FMCC order of digital beam figure.
The FMCC order that startup pick up facility PTZ adjusts is used to trigger pick up facility and carries out pickup control, and promptly pick up facility begins to carry out pickup control after receiving the FMCC order that starts microphone PTZ adjustment.A concrete example of the FMCC order that startup microphone PTZ adjusts is as shown in table 3.
Table 3
Figure GSA00000008463200271
FMCC order in the table 3 comprises four bytes.First byte is used to represent that this FMCC order is for starting the FMCC order of microphone PTZ adjustment.Second byte is a device id.The 3rd byte and nybble are as shown in table 4 below.
Table 4
Field Implication Length (bit) Value
R/L Pan adjusts 2 Not carrying out Pan adjusts: the 0x0 level is regulated left: the 0x2 level is regulated to the right: 0x3
U/D Tilt adjusts 2 Not carrying out Tilt adjusts: the 0x0 pitching is regulated downwards: the 0x2 pitching is to adjusted: 0x3
I/O Zoom adjusts 2 Not carrying out Zoom adjusts: 0x0 pickup zone narrows down: 0x2 pickup zone broadens: 0x3
BP Transmit beam pattern 2 Do not transmit and transmit outer beam pattern: the 0x3 of transmission of beam pattern: 0x2 band in beam pattern: the 0x00 band
Time?out Time-out time, above behind the time-out time, equipment stops to connect 4 Numerical value 0x0~0xf is a unit with 50 milliseconds, such as
Continuous adjusting is adjusted order or is started adjustment order unless receive continuation before overtime 0x2 represents 100 milliseconds, and 0x8 represents 400ms
Reserved Reserved field 4
In the table 4, R/L represents the pickup control to the horizontal direction of microphone, U/D represents the pickup control to the vertical direction of microphone, I/O represents the pickup control to the ZOOM of microphone, BP represents whether to feed back beam pattern and indicates when the feedback beam pattern and feed back beam pattern in which way, Time out represents time-out time, i.e. the timing length of pickup control, and Reserved is for keeping content.
When outside the FMCC of the startup PTZ adjustment that controlled device receives orders indication to need the passback beam pattern and need be with, transmitting beam pattern (BP=0x03), controlled device can be set up media channel in addition, and utilizing this media channel of setting up in addition to transmit beam pattern, controlled device also can adopt the mode of stack beam pattern on existing image to transmit beam pattern by existing media channel.Afterwards, controlled device is closed the media channel of above-mentioned other foundation or the operation of the beam pattern that stops superposeing after receiving the FMCC order that stops the PTZ adjustment.A concrete example that transmits beam pattern is: in video conference is used, open a logical channel through consultation, to transmit beam pattern, beam pattern can adopt and H.264 wait video or the compression of coding of graphics agreement to transmit.Another the concrete example that transmits beam pattern is: in video conference was used, the stack beam pattern transmitted together on live image that video camera is caught or film content image.
When in the FMCC of the startup PTZ adjustment that controlled device receives orders indication to need the passback beam pattern and need be with, transmitting beam pattern (BP=0x02), controlled device need be by sending the FMCC order passback beam pattern information of digital beam figure, and the beam pattern information of passback can be the coordinate information of beam pattern.
The FMCC order that continues the PTZ adjustment is used to impel pick up facility to proceed pickup control, and the concrete example that the FMCC that continuation microphone PTZ adjusts orders is as shown in table 5.
Table 5
Figure GSA00000008463200281
Figure GSA00000008463200291
FMCC order in the table 5 comprises three bytes.First byte is used to represent that this FMCC order is for continuing the FMCC order of PTZ adjustment.Second byte is a device id.The high 4 bit Time out of the 3rd byte are used to reset the timing length of pickup control, be that pick up facility is reset timer according to the value of the Time out in the FMCC order that continues microphone PTZ adjustment, and proceed PTZ and regulate, the value of Time out can be identical with the value of Time out in the table 4.The low 4 bit Reserved of the 3rd byte are for keeping content.
The FMCC order that stops the PTZ adjustment is used to control pick up facility and no longer carries out pickup control, and promptly pick up facility stops the pickup control operation after receiving the FMCC order that stops the PTZ adjustment.A concrete example that stops the FMCC order that PTZ adjusts is as shown in table 6.
Table 6
FMCC order in the table 6 comprises two bytes.First byte is used to represent that this FMCC order is for stopping the FMCC order of PTZ adjustment.Second byte is a device id.The FMCC order that stops the PTZ adjustment can not have parameter.
The FMCC order of storage PTZ position is used to trigger pick up facility and preserves current PTZ positional information, be to obtain current PTZ positional information of each pick up facility and storage after pick up facility receives the FMCC order of storing the PTZ position, the current PTZ positional information of pick up facility can be to there being numbering, when the current PTZ information of storage microphone, the numbering of correspondence can be stored together, so that follow-up index.A concrete example of the FMCC order of storage PTZ position is as shown in table 7.
Table 7
Figure GSA00000008463200301
FMCC order in the table 7 comprises three bytes.First byte is used to represent the FMCC order of this FMCC order for storage PTZ position.Second byte is a device id.The Preset number of high 4 bits of the 3rd byte represents Position Number, the span of Preset number can be 0~15, and the content of pick up facility storage can be the value of Preset number and the microphone PTZ positional information of this Preset number correspondence.The low 4 bit Reserved of the 3rd byte are for keeping content.
The prestore FMCC order of position of activation is used to trigger pick up facility and carries out pickup control according to the information that prestores, be after pick up facility receives the FMCC order that activates the position that prestores, obtain the pick up facility PTZ positional information that prestores, and carry out pickup control according to the microphone PTZ positional information that prestores.A concrete example of the FMCC order of the microphone position that activation prestores is as shown in table 8.
Table 8
Figure GSA00000008463200302
FMCC order in the table 8 comprises three bytes.First byte is used to represent that this FMCC order is for activating the FMCC order of the position that prestores.Second byte is a device id.The Presetnumber of high 4 bits of the 3rd byte represents the Position Number of the microphone PTZ positional information correspondence that activates, and same, the span of Preset number can be 0~15.The low 4 bit Reserved of the 3rd byte are for keeping content.
Pickup zone threshold values is set is used to be provided with the pickup edges of regions with respect to center amplitude fading ratio, can reach the effect of the proportion of the audio signal of regulating target pickup zone and background sound, an object lesson is as shown in table 9.
Table 9
Figure GSA00000008463200311
FMCC order in the table 9 comprises three bytes.First byte is used to represent that this FMCC order is for being provided with the FMCC order of pickup zone threshold values.Second byte is a device id.The Threshold of high 4 bits of the 3rd byte represents to be provided with the pickup edges of regions with respect to center amplitude fading ratio, and span can be 1~9, respectively correspondence 0.1~0.9.The low 4 bit Reserved of the 3rd byte are for keeping content.
The FMCC order that sends digital beam figure is used for pick up facility and feeds back beam pattern to control terminal, for example, controlled device is after receiving the FMCC order that starts microphone PTZ adjustment, if transmit beam pattern in the BP in this FMCC order represents to be with, then controlled device generates beam pattern according to the current pickup zone of pick up facility, and utilizes the FMCC order that sends digital beam figure to send beam pattern.A concrete example of the FMCC order of transmission digital beam figure is as shown in table 10.
Table 10
Figure GSA00000008463200312
Figure GSA00000008463200321
FMCC order in the table 10 comprises N byte.First byte is used to represent that this FMCC order is for sending the FMCC order of digital beam figure.Second byte is a device id.The 3rd byte is used to represent the numerical value of pick up facility present level direction, and nybble is used to represent the numerical value of the current vertical direction of pick up facility.The 5th byte is used to the ZOOM that represents that pick up facility is current.The 6th byte and the 7th byte are used to represent counting of beam pattern.The Eight characters is saved in the precision of expression beam pattern.The 9th byte is used to represent the compress mode of beam pattern.Description in subsequent byte such as the table 10.
When controlled device returns beam pattern in carrying out band, both can only transmit the P/T/Z angle information, also can only transmit beam pattern, can also the two transmit simultaneously.In addition, the controlled device describing mode that also beam pattern can be converted to rectangular coordinate transmits.The beam pattern here can adopt the polar coordinate mode pointwise to describe.Controlled device can utilize this FMCC order to transmit sparse or fine and close beam pattern as required, and the sparse or fine and close value by n is here determined.The receiving terminal of received beam figure can carry out the interpolation smoothing processing with the beam pattern that receives.
Also can realize at the transmission of the PTZ control signal of pick up facility and the transmission of beam pattern by the mode that in the order of (as agreement H.281) of existing video camera control protocol, increases field.
When video camera and pick up facility carry out PTZ when adjusting simultaneously, video camera can be followed pick up facility and be carried out PTZ and adjust, and not be used in independent transmission video camera control command; Pick up facility also can controlled terminal be set follows video camera and carries out PTZ and adjust, so just can use existing video camera control protocol to adjust the PTZ position of pick up facility simultaneously, also can in the order of video camera control protocol, indicate pick up facility and follow video camera and regulate (need expand so that pick up facility is set the video camera control protocol and follow the video camera adjustment), perhaps also can indicate pick up facility by independent negotiation and follow video camera and regulate; Control terminal also can send the synchronous adjustment that realizes the two at the control command of video camera with at the control command of pick up facility simultaneously.
The order of the PTZ control signal by local control interface transmission is similar substantially to foregoing description, no longer the command format of the PTZ control signal transmitted by local control interface is elaborated here.
The present invention also provides a kind of embodiment of pickup control device, and referring to Figure 12, this pickup control device comprises:
Receiver module 1201 is used to receive at pick up facility and carries out the control signal that the pickup zone is regulated, and makes the pickup zone of pick up facility be adjusted to target pickup zone by described control signal;
Parameter determination module 1202 is used for determining that according to described control signal the pickup zone in target pickup zone regulates parameter;
Pickup zone adjustment module 1203 is used for regulating parameter according to described pickup zone at least one microphone of described pick up facility is carried out pickup control, and the pickup zone of the audio signal correspondence of described pick up facility output is conformed to described target pickup zone.
Optionally, referring to Figure 13, described device also comprises as lower module:
Pickup control stopping modular 1204, be used to receive include the control signal that stops the pickup control information after, stop the reception of pickup control signal.
Can receive pickup by embodiments of the invention pickup control appliance and stop control messages, make things convenient for user's operation control.
Optionally, referring to Figure 14, described parameter determination module 1202 specifically comprises: signal transformation parameter determination module 1205 is used for definite parameter that the signal that at least one microphone picked up of described pick up facility is carried out signal transformation;
Described pickup zone adjustment module 1203 comprises:
Parameter transformation unit 12031 is used for that the microphone picked up audio signals of pending audio signal adjustment is carried out corresponding conversion and obtains changing signal afterwards;
Synthesis unit 12032 is used for the signal through the microphone after the parameter transformation of described pick up facility is synthesized, and obtains the audio signal of described pick up facility output.
Adopt embodiments of the invention can get access to corresponding audio signal transformation parameter, institute's picked up audio signals of pick up facility is carried out conversion, effectively solved the problem that can't realize the control of pick up facility in the prior art by extraneous control signal.
Optionally, referring to Figure 15, described parameter of carrying out signal transformation is: the amplitude of at least one microphone correspondence is adjusted parameter and/or phase place adjustment parameter in the described pick up facility;
Described parameter determination module 1202 specifically comprises: adjust parameter determination module 1206, be used for determining the amplitude adjustment parameter and/or the phase place adjustment parameter of at least one microphone correspondence of described pick up facility;
Described pickup zone adjustment module 1203 comprises:
Parameter transformation unit 12033 is used for utilizing described amplitude to adjust parameter and/or phase place and adjusts parameter at least one microphone of described pick up facility is carried out amplitude adjustment and/or phase place adjustment;
Synthesis unit 12034 is used for the signal through the microphone of parameter transformation of described pick up facility is synthesized, and obtains the audio signal of described pick up facility output.
Wherein, by the parameter that the weighted value among the method embodiment of the present invention is adjusted as audio frequency signal amplitude, adjust parameter as the phase place of the picked up audio signals of pick up facility by delay parameter.
Embodiments of the invention, realize the pick up facility picked up audio signals is carried out the control of amplitude adjustment and/or phase place adjustment by obtaining outside pickup Region control signal, effectively solved the problem of the interface chemical control system that can't realize pick up facility of prior art existence.
Optionally, referring to Figure 16, described parameter of carrying out signal transformation is: at least one microphone of described pick up facility carries out the position moving parameter of translation and/or rotation;
Described parameter determination module 1202 specifically comprises: position moving parameter determination module 1207 is used for the position moving parameter of determining that at least one microphone of described pick up facility carries out translation and/or rotation;
Described pickup zone adjustment module 1203 specifically comprises:
Control unit 12035, the position moving parameter that is used for utilizing described translation and/or rotation carries out translation and/or rotates control at least one microphone of described pick up facility, makes each microphone of accepting control reach the position moving parameter determined position corresponding with each microphone.
Optionally, referring to Figure 17, above-mentioned described control unit 12035 comprises:
Translation position control unit 120351, be used for moving at least one microphone and/or the shelter of regulating the described pick up facility of parameter adjustment, with the relative position of the relative shelter of at least one microphone of adjusting described pick up facility according at least one microphone translation position of described pick up facility;
Turned position control unit 120352 is used for moving according to described turned position and regulates parameter at least one microphone of described pick up facility is carried out level angle and/or luffing angle adjustment.
Pass through embodiments of the invention, can realize the microphone that is comprised in the pick up facility is carried out the function of position adjustments, promptly can realize the translation control and/or the rotation of the microphone that pick up facility comprised are controlled according to the pickup Region control signal of outside, by effective control, can effectively regulate the pickup zone of pick up facility to the microphone of pick up facility.
Optionally, referring to Figure 18, described parameter of carrying out signal transformation is: whether at least one microphone of described pick up facility the parameter of pickup;
Described parameter determination module 1202 specifically comprises: pickup determination module 1208, and whether at least one microphone that is used for determining described pick up facility the parameter of pickup;
Described pickup zone adjustment module 1203 comprises: be used for determining target pickup zone according to described control signal, and determine the position of sound source according to the auditory localization algorithm; Whether the position of judging described sound source is positioned at described target pickup zone, if it is that pickup is confirmed parameter that parameter is regulated in then described pickup zone, otherwise is that non-pickup is confirmed parameter;
When described pick up facility gets access to pickup affirmation parameter, control at least one microphone picked up audio signals of described pick up facility, otherwise at least one microphone of controlling described pick up facility does not carry out picking up of audio signal or at least one microphone institute picked up audio signals of described pick up facility is not obtained.
Whether embodiments of the invention can carry out pickup to pick up facility and effectively control, and having solved can't be by obtaining the problem that external parameter carries out the adjustment of pickup zone and pickup signal in the prior art.
Optionally, when the microphone number of described pick up facility is at least four, all microphones distribute at grade, perhaps other microphones except that first microphone of pick up facility are the polygon distribution, and first microphone of described pick up facility and described other microphones are polygonal pyramid shape and distribute.
Present embodiment provides the layout type of a plurality of microphones of pick up facility, by different layout type, can effectively control the pickup zone.
Wherein, the sine value of the maximum pickup angle of the maximum of the spacing of two microphones arbitrarily of described pick up facility and described single microphone is inverse ratio.
Optionally, described pick up facility also is provided with and is exclusively used in the microphone that picks up background sound, the background sound that the described microphone that is used to pick up background sound picks up through after the overdamping with described pickup control after the audio signal stack.
Wherein, described pickup control device also comprises: the background sound adjustment module, the control signal that is used for regulating from pickup zone extracts and is used for controlling the Control Parameter of background sound than re-correlation, according to this Control Parameter at least one microphone of described pick up facility is carried out pickup control, make the audio signal background sound proportion respective change of output.
Can effectively change by embodiments of the invention and can't realize in the prior art that the audio signal that pick up facility is obtained carries out the adjusting problem of foreground voice and background sound, by embodiments of the invention, can
Figure 19 is a realization technical scheme block diagram of the present invention, wherein
Microphone unit comprises one or for a plurality of (array) directional microphones and/or the Mike of omnidirectional;
Network interface is used for receiving by network the PTZ control command to microphone of far-end, network interface can be based on the IP network of packet switching or Circuit-switched ISDN, E1 network, comprise wired (as Ethernet, xDSL etc.) and wireless (as WiFi, WiMAX, UMTS, CDMA2000, TD-SCDMA) access way, realize the control of far-end pick up facility by the far-end control protocol;
Local control interface is used to receive local PTZ control command to microphone, and interface can be wired or wireless interfaces such as infrared, bluetooth, RS232, finishes the control of local pick up facility by the control protocol of this locality;
The PTZ control unit is converted to pickup zone regulon and the required parameter of The Cloud Terrace (optional) with the PTZ control signal;
Pickup zone regulon carries out the processing such as weighting of phase place and amplitude, the audio signal of output and PTZ corresponding region, the extra-regional signal of filtering to the digital audio and video signals of array microphone input.Pickup zone regulon also can adopt the mode in the prior art 1 to carry out ZOOM and regulate, and regulates the pickup angle by hiding relation, mechanically replaces array microphone to carry out ZOOM and regulates;
The Cloud Terrace (optionally), mechanically the substitute array microphone carries out the adjustment of level (P) and pitching (T);
The audio adjustment unit further carries out the amplification (can be synchronous with video scaling) of sound, background sound special processing etc.
In the practical adjustments process, for real-time feedback effects can be arranged, can adopt continuous regulative mode, be that the user sends an order that starts adjusting, the PTZ control module is just regulated parameter (is increment with certain step-length) with the generation that certain frequency continues, and sends the order that stops to regulate up to the user.
Through the above description of the embodiments, those skilled in the art can be well understood to the present invention and can realize by the mode that software adds essential hardware platform, can certainly all implement, but the former is better execution mode under a lot of situation by hardware.Based on such understanding, all or part of can the embodying that technical scheme of the present invention contributes to background technology with the form of software product, this computer software product can be stored in the storage medium, as ROM/RAM, magnetic disc, CD etc., comprise that some instructions are with so that a computer equipment (can be a personal computer, server, the perhaps network equipment etc.) carry out the described method of some part of each embodiment of the present invention or embodiment.
Though described the present invention by embodiment, those of ordinary skills know, the present invention has many distortion and variation and do not break away from spirit of the present invention, and the claim of application documents of the present invention comprises these distortion and variation.

Claims (21)

1. a pick-up control method is characterized in that, comprising:
Reception is carried out the control signal of pickup Region control to pick up facility, makes the pickup zone of pick up facility be adjusted to target pickup zone by described control signal;
Determine the pickup zone adjusting parameter in target pickup zone according to described control signal;
Regulate parameter according to described pickup zone at least one microphone in the described pick up facility is carried out pickup control, the pickup zone of the audio signal correspondence of described pick up facility output is conformed to described target pickup zone.
2. the method for claim 1 is characterized in that, describedly determines that according to described control signal the pickup zone in target pickup zone regulates parameter, at least one microphone in the described pickup zone is carried out pickup control comprise:
When described control signal comprises the log-on message of pickup control, utilize the pickup zone in target pickup zone to regulate parameter described pick up facility is regulated, stop the control signal of pickup control or up to having adjusted pre-determined number or having reached scheduled duration up to lasting duration up to receiving to include at described pick up facility.
3. method as claimed in claim 1 or 2 is characterized in that, described pickup zone is regulated parameter and comprised: the parameter of the signal that at least one microphone picked up of described pick up facility being carried out signal transformation;
And describedly regulate parameter according to described pickup zone and at least one microphone of described pick up facility is carried out pickup control comprise:
When parameter is regulated when carrying out pickup control at a microphone of pick up facility in described pickup zone, then this microphone picked up audio signals is carried out signal after corresponding conversion obtains conversion according to the parameter of described signal transformation, other microphone picked up audio signals of signal after this conversion and described pick up facility are synthesized, with filtering or reduce not belong to the audio signal in described target pickup zone;
When parameter is regulated when carrying out pickup control at two of pick up facility and plural microphone in described pickup zone, then utilize the parameter of its corresponding signal transformation to carry out the signal of corresponding conversion after obtaining changing respectively at described two and plural microphone picked up audio signals, other microphone picked up audio signals of signal after this two or more microphone picked up audio signals conversion and described pick up facility are synthesized, with filtering or reduce not belong to the audio signal in described target pickup zone.
4. method as claimed in claim 3 is characterized in that, the parameter that the signal of described at least one microphone to pick up facility carries out signal transformation is: the amplitude of at least one microphone correspondence is adjusted parameter and/or phase place is adjusted parameter in the described pick up facility;
And describedly regulate parameter according to described pickup zone and at least one microphone of described pick up facility is carried out pickup control comprise:
When parameter is regulated when carrying out pickup control at a microphone of pick up facility in described pickup zone, then adjusting parameter and/or phase place according to described amplitude adjusts parameter the amplitude of this microphone picked up audio signals and/or phase place is carried out signal after corresponding conversion obtains conversion, other microphone picked up audio signals of signal after this conversion and described pick up facility are synthesized,, with filtering or reduce not belong to the audio signal in described target pickup zone;
When parameter is regulated when carrying out pickup control at two of pick up facility and plural microphone in described pickup zone, then utilizing its corresponding amplitude to adjust parameter and/or phase place respectively at described two and plural microphone picked up audio signals adjusts parameter and carries out the signal of corresponding conversion after obtaining changing, other microphone picked up audio signals of signal after this two or more microphone picked up audio signals conversion and described pick up facility are synthesized, with filtering or reduce not belong to the audio signal in described target pickup zone.
5. method as claimed in claim 1 or 2 is characterized in that, described pickup zone is regulated parameter and comprised: at least one microphone of described pick up facility carries out the position moving parameter of translation and/or rotation;
And describedly regulate parameter according to described pickup zone and at least one microphone of described pick up facility is carried out pickup control comprise:
When to regulate parameter be microphone at described pick up facility in described pickup zone, then utilize the position moving parameter of described translation and/or rotation that described microphone is carried out translation and/or rotates control, this microphone is reached and this determined position of position moving parameter;
When to regulate parameter be a plurality of microphone at described pickup zone in described pickup zone, then utilize described at each microphone translation and/or the position moving parameter of rotation described each microphone is carried out translation respectively and/or rotates control, make each microphone reach the position moving parameter determined position corresponding with each microphone.
6. method as claimed in claim 5 is characterized in that, the position moving parameter of the translation of at least one microphone of described pick up facility is: the adjusting parameter is moved in the translation position of the pickup angle correspondence of described at least one microphone of pick up facility; The position moving parameter of the rotation of at least one microphone of described pick up facility is: the adjusting parameter is moved in the turned position of the pickup orientation correspondence of at least one microphone of described pick up facility;
And describedly regulate parameter according to described pickup zone and at least one microphone of described pick up facility is carried out pickup control comprise:
Move at least one microphone and/or the shelter of regulating the described pick up facility of parameter adjustment according at least one microphone translation position of described pick up facility, with the relative position of the relative shelter of at least one microphone of adjusting described pick up facility;
And/or
Move according to described turned position and to regulate parameter at least one microphone of described pick up facility is carried out level and/or luffing angle adjustment.
7. method as claimed in claim 1 or 2 is characterized in that, described pickup zone is regulated parameter and comprised: whether at least one microphone of described pick up facility the parameter of pickup;
And describedly determine that according to described control signal the pickup zone in target pickup zone regulates parameter, regulate parameter according to described pickup zone and at least one microphone of described pick up facility is carried out pickup control comprise:
Determine target pickup zone according to described control signal, and determine the position of sound source according to the auditory localization algorithm;
Whether the position of judging described sound source is positioned at described target pickup zone, if it is that pickup is confirmed parameter that parameter is regulated in then described pickup zone, otherwise is that non-pickup is confirmed parameter;
When described pick up facility gets access to pickup affirmation parameter, control at least one microphone picked up audio signals of described pick up facility, otherwise at least one microphone of controlling described pick up facility does not carry out picking up of audio signal or at least one microphone institute picked up audio signals of described pick up facility is not obtained.
8. as claim 4 or 6 any described methods, it is characterized in that, describedly regulate parameter according to described pickup zone and described pick up facility is carried out pickup control also comprise:
Gain to the composite signal of each microphone institute picked up audio signals of described pick up facility is adjusted, and described gain reduces and increases with the pickup angle of described pick up facility.
9. method as claimed in claim 1 or 2, it is characterized in that, described reception also comprises at the control signal that pick up facility carries out the pickup Region control: receive the Control Parameter of control background sound than re-correlation, according to this Control Parameter described pick up facility is carried out pickup control, make the audio signal background sound proportion respective change of output.
10. method as claimed in claim 1 or 2 is characterized in that, described control signal of carrying out regulating in the pickup zone is the P/T/Z control signal to described pick up facility at the pickup zone.
11. a pickup control device is characterized in that, comprising:
Receiver module is used to receive at pick up facility and carries out the control signal that the pickup zone is regulated, and makes the pickup zone of pick up facility be adjusted to target pickup zone by described control signal;
The parameter determination module is used for determining that according to described control signal the pickup zone in target pickup zone regulates parameter;
Pickup zone adjustment module is used for regulating parameter according to described pickup zone at least one microphone of described pick up facility is carried out pickup control, and the pickup zone of the audio signal correspondence of described pick up facility output is conformed to described target pickup zone.
12. device as claimed in claim 11 is characterized in that, described device also comprises:
Pickup control stopping modular, be used to receive include the control signal that stops the pickup control information after, stop the reception of pickup control signal.
13. device as claimed in claim 11 is characterized in that, described parameter determination module is specially: signal transformation parameter determination module is used for definite parameter that the signal that at least one microphone picked up of described pick up facility is carried out signal transformation;
Described pickup zone adjustment module comprises:
The parameter transformation unit is used for that the microphone picked up audio signals of pending audio signal adjustment is carried out corresponding conversion and obtains changing signal afterwards;
Synthesis unit is used for the signal through the microphone after the parameter transformation of described pick up facility is synthesized, and obtains the audio signal of described pick up facility output.
14. device as claimed in claim 13 is characterized in that, described parameter of carrying out signal transformation is: the amplitude of at least one microphone correspondence is adjusted parameter and/or phase place adjustment parameter in the described pick up facility;
Described parameter determination module comprises: adjust the parameter determination module, be used for determining the amplitude adjustment parameter and/or the phase place adjustment parameter of at least one microphone correspondence of described pick up facility;
Described pickup zone adjustment module comprises:
The parameter transformation unit is used for utilizing described amplitude to adjust parameter and/or phase place and adjusts parameter at least one microphone of described pick up facility is carried out amplitude adjustment and/or phase place adjustment;
Synthesis unit is used for the signal through the microphone of parameter transformation of described pick up facility is synthesized, and obtains the audio signal of described pick up facility output.
15. device as claimed in claim 11 is characterized in that, described parameter of carrying out signal transformation is: at least one microphone of described pick up facility carries out the position moving parameter of translation and/or rotation;
Described parameter determination module comprises: position moving parameter determination module is used for the position moving parameter of determining that at least one microphone of described pick up facility carries out translation and/or rotation;
Described pickup zone adjustment module comprises:
Control unit, the position moving parameter that is used for utilizing described translation and/or rotation carries out translation and/or rotates control at least one microphone of described pick up facility, makes each microphone of accepting control reach the position moving parameter determined position corresponding with each microphone.
16. device as claimed in claim 15 is characterized in that, described control unit comprises:
The translation position control unit, be used for moving at least one microphone and/or the shelter of regulating the described pick up facility of parameter adjustment, with the relative position of the relative shelter of at least one microphone of adjusting described pick up facility according at least one microphone translation position of described pick up facility;
The turned position control unit is used for moving according to described turned position and regulates parameter at least one microphone of described pick up facility is carried out level angle and/or luffing angle adjustment.
17. device as claimed in claim 11 is characterized in that, described parameter of carrying out signal transformation is: whether at least one microphone of described pick up facility the parameter of pickup;
Described parameter determination module comprises: the pickup determination module, and whether at least one microphone that is used for determining described pick up facility the parameter of pickup;
Described pickup zone adjustment module comprises: be used for determining target pickup zone according to described control signal, and determine the position of sound source according to the auditory localization algorithm; Whether the position of judging described sound source is positioned at described target pickup zone, if it is that pickup is confirmed parameter that parameter is regulated in then described pickup zone, otherwise is that non-pickup is confirmed parameter;
When described pick up facility gets access to pickup affirmation parameter, control at least one microphone picked up audio signals of described pick up facility, otherwise at least one microphone of controlling described pick up facility does not carry out picking up of audio signal or at least one microphone institute picked up audio signals of described pick up facility is not obtained.
18. device as claimed in claim 11, it is characterized in that, when the microphone number of described pick up facility is at least four, all microphones distribute at grade, perhaps other microphones except that first microphone of pick up facility are the polygon distribution, and first microphone of described pick up facility and described other microphones are polygonal pyramid shape and distribute.
19. method as claimed in claim 18 is characterized in that, the sine value of the maximum of the spacing of two microphones arbitrarily of described pick up facility and the maximum pickup angle of described single microphone is inverse ratio.
20. device as claimed in claim 11, it is characterized in that, described pick up facility also is provided with and is exclusively used in the microphone that picks up background sound, the background sound that the described microphone that is used to pick up background sound picks up through after the overdamping with described pickup control after the audio signal stack.
21. device as claimed in claim 20, it is characterized in that, described device also comprises: the background sound adjustment module, the control signal that is used for regulating from pickup zone extracts and is used for controlling the Control Parameter of background sound than re-correlation, according to this Control Parameter described pick up facility is carried out pickup control, make the audio signal background sound proportion respective change of output.
CN201010103244.4A 2010-01-22 2010-01-22 Method and device for controlling adapterization Expired - Fee Related CN102137318B (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN201010103244.4A CN102137318B (en) 2010-01-22 2010-01-22 Method and device for controlling adapterization
PCT/CN2011/070452 WO2011088796A1 (en) 2010-01-22 2011-01-21 Control method and device for picking up sounds

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201010103244.4A CN102137318B (en) 2010-01-22 2010-01-22 Method and device for controlling adapterization

Publications (2)

Publication Number Publication Date
CN102137318A true CN102137318A (en) 2011-07-27
CN102137318B CN102137318B (en) 2014-08-20

Family

ID=44296956

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201010103244.4A Expired - Fee Related CN102137318B (en) 2010-01-22 2010-01-22 Method and device for controlling adapterization

Country Status (2)

Country Link
CN (1) CN102137318B (en)
WO (1) WO2011088796A1 (en)

Cited By (31)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103986996A (en) * 2014-05-14 2014-08-13 许忠 Meeting system based on array type microphones
CN104010251A (en) * 2013-02-27 2014-08-27 晨星半导体股份有限公司 Radio system and related method
CN104934037A (en) * 2015-06-02 2015-09-23 阔地教育科技有限公司 Audio processing method and device for direct recording and broadcasting interaction system
CN106338290A (en) * 2016-10-26 2017-01-18 山东大学 Navigation system automatically charged by robot and method
CN106604191A (en) * 2016-12-20 2017-04-26 广州视源电子科技股份有限公司 Sound amplification method and sound amplification system
CN106604183A (en) * 2015-10-20 2017-04-26 华为终端(东莞)有限公司 Method and device of controlling pickup range of multi-microphone denoising of terminal
CN107277699A (en) * 2017-07-21 2017-10-20 歌尔科技有限公司 A kind of sound pick-up method and device
CN107734426A (en) * 2017-08-28 2018-02-23 深圳市金立通信设备有限公司 Acoustic signal processing method, terminal and computer-readable recording medium
CN108172236A (en) * 2018-01-12 2018-06-15 歌尔科技有限公司 A kind of pickup noise-reduction method and intelligent electronic device
CN108200515A (en) * 2017-12-29 2018-06-22 苏州科达科技股份有限公司 Multi-beam meeting pickup system and method
CN103873998B (en) * 2012-12-17 2018-07-03 联想(北京)有限公司 Electronic equipment and sound collection method
CN108307259A (en) * 2018-01-24 2018-07-20 腾讯科技(深圳)有限公司 Noise Processing for removing method, apparatus, computer equipment, storage medium and speaker
CN109151672A (en) * 2018-09-19 2019-01-04 西安交通大学 Audio source tracking system and its control method based on array microphone
WO2019011189A1 (en) * 2017-07-12 2019-01-17 中兴通讯股份有限公司 Audio and video acquisition method and apparatus for conference television, and terminal device
WO2019041316A1 (en) * 2017-09-01 2019-03-07 深圳市台电实业有限公司 Sound pickup device and system
TWI663593B (en) * 2018-07-10 2019-06-21 國立成功大學 Optical pickup and string music translation system
CN109920443A (en) * 2019-03-22 2019-06-21 网易有道信息技术(北京)有限公司 A kind of speech processes machine
CN110035220A (en) * 2018-09-11 2019-07-19 真善美创新科技有限公司 Apparatus control system and method for photography
CN110134364A (en) * 2019-05-17 2019-08-16 深圳市台电实业有限公司 Audio R-T unit, wisdom classroom audio control system and method
CN110178386A (en) * 2017-01-09 2019-08-27 索诺瓦公司 Microphone assembly for being worn at user's chest
CN110364176A (en) * 2019-08-21 2019-10-22 百度在线网络技术(北京)有限公司 Audio signal processing method and device
CN110447237A (en) * 2017-03-24 2019-11-12 雅马哈株式会社 Sound pick up equipment and sound pick-up method
CN110858943A (en) * 2018-08-24 2020-03-03 纬创资通股份有限公司 Sound reception processing device and sound reception processing method thereof
CN111246339A (en) * 2019-12-31 2020-06-05 上海景吾智能科技有限公司 Method and system for adjusting pickup direction, storage medium and intelligent robot
CN111479180A (en) * 2019-01-24 2020-07-31 Oppo广东移动通信有限公司 Pickup control method and related product
CN112055122A (en) * 2020-08-07 2020-12-08 联想(北京)有限公司 Conference component equipment, conference equipment and data processing method
CN112470215A (en) * 2019-12-03 2021-03-09 深圳市大疆创新科技有限公司 Control method and device and movable platform
CN113348676A (en) * 2019-02-14 2021-09-03 松下电器(美国)知识产权公司 Microphone device
WO2022016533A1 (en) * 2020-07-24 2022-01-27 深圳市大疆创新科技有限公司 Audio processing method and electronic device
CN114827821A (en) * 2022-04-25 2022-07-29 世邦通信股份有限公司 Pickup control method and system for pickup, pickup apparatus, and storage medium
CN117412223A (en) * 2023-12-14 2024-01-16 深圳市声菲特科技技术有限公司 Method, device, equipment and storage medium for far-field pickup

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1328395A (en) * 2000-06-09 2001-12-26 程滋颐 Noise-reducing microphone
US20070058822A1 (en) * 2005-09-12 2007-03-15 Sony Corporation Noise reducing apparatus, method and program and sound pickup apparatus for electronic equipment
CN101278596A (en) * 2005-09-30 2008-10-01 史克尔海德科技公司 Directional audio capturing
CN201307345Y (en) * 2008-10-29 2009-09-09 北京中庆现代技术有限公司 Course automatic recording broadcasting system
CN201349250Y (en) * 2008-12-23 2009-11-18 康佳集团股份有限公司 Mobile communication terminal

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2004180197A (en) * 2002-11-29 2004-06-24 Canon Inc Information processor, information processing method, and recording medium
US6814332B2 (en) * 2003-01-15 2004-11-09 Ultimate Support Systems, Inc. Microphone support boom movement control apparatus and method with differential motion isolation capability
JP4816221B2 (en) * 2006-04-21 2011-11-16 ヤマハ株式会社 Sound pickup device and audio conference device
KR101409169B1 (en) * 2007-09-05 2014-06-19 삼성전자주식회사 Sound zooming method and apparatus by controlling null widt

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1328395A (en) * 2000-06-09 2001-12-26 程滋颐 Noise-reducing microphone
US20070058822A1 (en) * 2005-09-12 2007-03-15 Sony Corporation Noise reducing apparatus, method and program and sound pickup apparatus for electronic equipment
CN101278596A (en) * 2005-09-30 2008-10-01 史克尔海德科技公司 Directional audio capturing
CN201307345Y (en) * 2008-10-29 2009-09-09 北京中庆现代技术有限公司 Course automatic recording broadcasting system
CN201349250Y (en) * 2008-12-23 2009-11-18 康佳集团股份有限公司 Mobile communication terminal

Cited By (51)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108769883A (en) * 2012-12-17 2018-11-06 联想(北京)有限公司 Electronic equipment and sound collection method
CN103873998B (en) * 2012-12-17 2018-07-03 联想(北京)有限公司 Electronic equipment and sound collection method
CN104010251B (en) * 2013-02-27 2018-06-19 晨星半导体股份有限公司 Radio system and correlation technique
CN104010251A (en) * 2013-02-27 2014-08-27 晨星半导体股份有限公司 Radio system and related method
CN103986996B (en) * 2014-05-14 2016-04-27 深圳市达威思智能科技有限公司 A kind of conference system based on Array Microphone
CN103986996A (en) * 2014-05-14 2014-08-13 许忠 Meeting system based on array type microphones
CN104934037A (en) * 2015-06-02 2015-09-23 阔地教育科技有限公司 Audio processing method and device for direct recording and broadcasting interaction system
CN104934037B (en) * 2015-06-02 2019-06-25 阔地教育科技有限公司 Audio-frequency processing method and device in a kind of straight recorded broadcast interaction systems
CN106604183A (en) * 2015-10-20 2017-04-26 华为终端(东莞)有限公司 Method and device of controlling pickup range of multi-microphone denoising of terminal
CN106338290B (en) * 2016-10-26 2021-03-16 山东大学 Navigation system and method for autonomous charging of robot
CN106338290A (en) * 2016-10-26 2017-01-18 山东大学 Navigation system automatically charged by robot and method
CN106604191A (en) * 2016-12-20 2017-04-26 广州视源电子科技股份有限公司 Sound amplification method and sound amplification system
CN110178386B (en) * 2017-01-09 2021-10-15 索诺瓦公司 Microphone assembly for wearing at the chest of a user
CN110178386A (en) * 2017-01-09 2019-08-27 索诺瓦公司 Microphone assembly for being worn at user's chest
CN110447237A (en) * 2017-03-24 2019-11-12 雅马哈株式会社 Sound pick up equipment and sound pick-up method
US11758322B2 (en) 2017-03-24 2023-09-12 Yamaha Corporation Sound pickup device and sound pickup method
CN110447237B (en) * 2017-03-24 2022-04-15 雅马哈株式会社 Sound pickup device and sound pickup method
US11197091B2 (en) 2017-03-24 2021-12-07 Yamaha Corporation Sound pickup device and sound pickup method
WO2019011189A1 (en) * 2017-07-12 2019-01-17 中兴通讯股份有限公司 Audio and video acquisition method and apparatus for conference television, and terminal device
CN107277699A (en) * 2017-07-21 2017-10-20 歌尔科技有限公司 A kind of sound pick-up method and device
WO2019015159A1 (en) * 2017-07-21 2019-01-24 歌尔科技有限公司 Sound pickup method and device
CN107734426A (en) * 2017-08-28 2018-02-23 深圳市金立通信设备有限公司 Acoustic signal processing method, terminal and computer-readable recording medium
WO2019041316A1 (en) * 2017-09-01 2019-03-07 深圳市台电实业有限公司 Sound pickup device and system
CN108200515A (en) * 2017-12-29 2018-06-22 苏州科达科技股份有限公司 Multi-beam meeting pickup system and method
CN108172236B (en) * 2018-01-12 2021-08-20 歌尔科技有限公司 Pickup noise reduction method and intelligent electronic equipment
CN108172236A (en) * 2018-01-12 2018-06-15 歌尔科技有限公司 A kind of pickup noise-reduction method and intelligent electronic device
CN108307259B (en) * 2018-01-24 2019-08-23 腾讯科技(深圳)有限公司 Noise Processing for removing method, apparatus, computer equipment, storage medium and speaker
CN108307259A (en) * 2018-01-24 2018-07-20 腾讯科技(深圳)有限公司 Noise Processing for removing method, apparatus, computer equipment, storage medium and speaker
TWI663593B (en) * 2018-07-10 2019-06-21 國立成功大學 Optical pickup and string music translation system
CN110858943A (en) * 2018-08-24 2020-03-03 纬创资通股份有限公司 Sound reception processing device and sound reception processing method thereof
US10873805B2 (en) 2018-08-24 2020-12-22 Wistron Corporation Sound processing apparatus and audio signals processing method thereof based on sound source position
CN110035220A (en) * 2018-09-11 2019-07-19 真善美创新科技有限公司 Apparatus control system and method for photography
CN109151672B (en) * 2018-09-19 2022-08-05 西安交通大学 Sound source tracking system based on array microphone and control method thereof
CN109151672A (en) * 2018-09-19 2019-01-04 西安交通大学 Audio source tracking system and its control method based on array microphone
CN111479180B (en) * 2019-01-24 2022-04-29 Oppo广东移动通信有限公司 Pickup control method and related product
CN111479180A (en) * 2019-01-24 2020-07-31 Oppo广东移动通信有限公司 Pickup control method and related product
CN113348676A (en) * 2019-02-14 2021-09-03 松下电器(美国)知识产权公司 Microphone device
CN109920443A (en) * 2019-03-22 2019-06-21 网易有道信息技术(北京)有限公司 A kind of speech processes machine
CN110134364B (en) * 2019-05-17 2024-05-03 深圳市台电实业有限公司 Audio transceiver, intelligent classroom audio control system and method
CN110134364A (en) * 2019-05-17 2019-08-16 深圳市台电实业有限公司 Audio R-T unit, wisdom classroom audio control system and method
CN110364176A (en) * 2019-08-21 2019-10-22 百度在线网络技术(北京)有限公司 Audio signal processing method and device
CN112470215A (en) * 2019-12-03 2021-03-09 深圳市大疆创新科技有限公司 Control method and device and movable platform
CN111246339A (en) * 2019-12-31 2020-06-05 上海景吾智能科技有限公司 Method and system for adjusting pickup direction, storage medium and intelligent robot
CN111246339B (en) * 2019-12-31 2021-12-07 上海景吾智能科技有限公司 Method and system for adjusting pickup direction, storage medium and intelligent robot
WO2022016533A1 (en) * 2020-07-24 2022-01-27 深圳市大疆创新科技有限公司 Audio processing method and electronic device
CN112055122B (en) * 2020-08-07 2021-12-24 联想(北京)有限公司 Conference component equipment, conference equipment and data processing method
CN112055122A (en) * 2020-08-07 2020-12-08 联想(北京)有限公司 Conference component equipment, conference equipment and data processing method
CN114827821A (en) * 2022-04-25 2022-07-29 世邦通信股份有限公司 Pickup control method and system for pickup, pickup apparatus, and storage medium
CN114827821B (en) * 2022-04-25 2024-06-11 世邦通信股份有限公司 Pickup control method and system, pickup device, and storage medium
CN117412223A (en) * 2023-12-14 2024-01-16 深圳市声菲特科技技术有限公司 Method, device, equipment and storage medium for far-field pickup
CN117412223B (en) * 2023-12-14 2024-06-07 深圳市声菲特科技技术有限公司 Method, device and equipment for far-field pickup

Also Published As

Publication number Publication date
CN102137318B (en) 2014-08-20
WO2011088796A1 (en) 2011-07-28

Similar Documents

Publication Publication Date Title
CN102137318B (en) Method and device for controlling adapterization
EP3646619B1 (en) Mixed-order ambisonics (moa) audio data for computer-mediated reality systems
CN101820537B (en) Moving picture data encoding method, terminal device, and bi-directional interactive system
WO2015174501A1 (en) 360-degree video-distributing system, 360-degree video distribution method, image-processing device, and communications terminal device, as well as control method therefor and control program therefor
US20020075295A1 (en) Telepresence using panoramic imaging and directional sound
JP2005500721A5 (en)
US10296281B2 (en) Handheld multi vantage point player
JP2015220595A (en) Perimeter motion picture distribution system, perimeter motion picture distribution method, communication terminal device, and method and program for controlling the same
JP2008113425A (en) Apparatus for video access and control over computer network, including image correction
CN110333837B (en) Conference system, communication method and device
JP6002191B2 (en) All-round video distribution system, all-round video distribution method, communication terminal device, and control method and control program thereof
US20160314596A1 (en) Camera view presentation method and system
WO2012100114A2 (en) Multiple viewpoint electronic media system
US20180227694A1 (en) Audio capture for multi point image capture systems
US20150304724A1 (en) Multi vantage point player
US10664225B2 (en) Multi vantage point audio player
US20200358415A1 (en) Information processing apparatus, information processing method, and program
US20230276189A1 (en) Real-time sound field synthesis by modifying produced audio streams
TW201734948A (en) A method, system and device for generating associated audio and visual signals in a wide angle image system
CN108076304A (en) A kind of built-in projection and the method for processing video frequency and conference system of camera array
US20150256762A1 (en) Event specific data capture for multi-point image capture systems
CN113438548B (en) Digital television display method and device based on video data packet and audio data packet
WO2021124680A1 (en) Information processing device and information processing method
GB2348560A (en) Transmitting foreground object signals and background image signals separately
EP4176334B1 (en) Remote attendance and participation systems and methods

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant
TR01 Transfer of patent right

Effective date of registration: 20180202

Address after: California, USA

Patentee after: Global innovation polymerization LLC

Address before: California, USA

Patentee before: Tanous Co.

Effective date of registration: 20180202

Address after: California

Patentee after: Tanous Co.

Address before: 518129 Longgang District, Guangdong, Bantian HUAWEI base B District, building 2, building No.

Patentee before: HUAWEI DEVICE Co.,Ltd.

TR01 Transfer of patent right
TR01 Transfer of patent right

Effective date of registration: 20180212

Address after: California, USA

Patentee after: Global innovation polymerization LLC

Address before: California, USA

Patentee before: Tanous Co.

Effective date of registration: 20180212

Address after: California, USA

Patentee after: Tanous Co.

Address before: 518129 Longgang District, Guangdong, Bantian HUAWEI base B District, building 2, building No.

Patentee before: HUAWEI DEVICE Co.,Ltd.

TR01 Transfer of patent right
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20140820

Termination date: 20220122

CF01 Termination of patent right due to non-payment of annual fee