CN108254721A - A kind of positioning sound source by robot and robot - Google Patents
A kind of positioning sound source by robot and robot Download PDFInfo
- Publication number
- CN108254721A CN108254721A CN201810330841.7A CN201810330841A CN108254721A CN 108254721 A CN108254721 A CN 108254721A CN 201810330841 A CN201810330841 A CN 201810330841A CN 108254721 A CN108254721 A CN 108254721A
- Authority
- CN
- China
- Prior art keywords
- microphone
- robot
- sound source
- section
- target sound
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S5/00—Position-fixing by co-ordinating two or more direction or position line determinations; Position-fixing by co-ordinating two or more distance determinations
- G01S5/18—Position-fixing by co-ordinating two or more direction or position line determinations; Position-fixing by co-ordinating two or more distance determinations using ultrasonic, sonic, or infrasonic waves
- G01S5/20—Position of source determined by a plurality of spaced direction-finders
Landscapes
- Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Radar, Positioning & Navigation (AREA)
- Remote Sensing (AREA)
- Manipulator (AREA)
- Circuit For Audible Band Transducer (AREA)
Abstract
The embodiment of the present application provides a kind of positioning sound source by robot and robot, is provided with two-dimentional microphone array in robot, this method includes:According to the collected voice data from target sound source of the first microphone, the first sound energy value that the first microphone obtains is calculated;According to the collected voice data from target sound source of second microphone, the second sound energy value that second microphone obtains is calculated;According to the first sound energy value and the energy ratio of second sound energy value and the position relationship of the first microphone and second microphone, orientation section of the target sound source relative to robot is determined.In the embodiment of the present application, it can determine whether out that target sound source is located at the front or rear of robot, and then realizes the actual position that target sound source is accurately positioned.
Description
Technical field
This application involves signal processing technology field more particularly to a kind of positioning sound source by robot and robot.
Background technology
The hot spot that auditory localization is field of voice signal in recent years is carried out based on microphone array, this technology is
It is applied in video conference, intelligent robot etc. scene.At present, auditory localization mainly using annular microphone array or
The linear microphone array of person is realized.Wherein it is possible to according to the selection of the form of robot using the microphone array of which kind of shape.Example
Such as, for the short household intelligent robot of build, annular microphone array can be used and carry out auditory localization, and for build height
Big intelligent robot can be used linear microphone array and carry out auditory localization.
For the tall and big intelligent robot of build, linear microphone array is generally positioned at its thoracic cavity position, and base
Linear microphone array at its thoracic cavity carries out auditory localization.But the existing linear microphone array progress sound source that is based on is determined
The robot of position can not determine that sound source is located at the front or rear of intelligent robot sometimes, lead to not sound source is accurately positioned.
Invention content
The many aspects of the application provide a kind of positioning sound source by robot and robot, to improve auditory localization
Accuracy.
The embodiment of the present application provides a kind of positioning sound source by robot, suitable for robot, is set in the robot
There is two-dimentional microphone array, the method includes:
According to the collected voice data from target sound source of the first microphone, calculate what first microphone obtained
First sound energy value, wherein, first microphone is located at first straight line for array element center in the two-dimentional microphone array
On any microphone;
According to the collected voice data from the target sound source of second microphone, calculate the second microphone and obtain
Second sound energy value, wherein, the second microphone is array element center in the two-dimentional microphone array and described the
One straight line mutually from microphone;
According to the energy ratio and first Mike of first sound energy value and the second sound energy value
The position relationship of wind and the second microphone, determines orientation section of the target sound source relative to the robot.
The embodiment of the present application also provides a kind of robot, including memory, processor and two-dimentional microphone array;
The two dimension microphone array include array element center be located at microphone in first straight line and array element center with it is described
First straight line mutually from microphone;
The memory is used to store computer program;
The processor, for performing the computer program, for:
According to the collected voice data from target sound source of the first microphone, calculate what first microphone obtained
First sound energy value, wherein, first microphone is located at any microphone in first straight line for array element center;
According to the collected voice data from the target sound source of second microphone, calculate the second microphone and obtain
Second sound energy value, wherein, the second microphone for array element center and the first straight line phase from microphone;
According to the energy ratio and first Mike of first sound energy value and the second sound energy value
The position relationship of wind and the second microphone, determines orientation section of the target sound source relative to the robot.
In the embodiment of the present application, two-dimentional microphone array in robot is set, and passes through array element center not at one
The acoustic energy between the first microphone and second microphone on the straight line when position relationship between two microphones, can be true
Orientation section of the target sound source relative to robot is made, such as may determine that target sound source is located at the front of robot still
Rear, and then realize the actual position that target sound source is accurately positioned.
Description of the drawings
Attached drawing described herein is used for providing further understanding of the present application, forms the part of the application, this Shen
Illustrative embodiments and their description please do not form the improper restriction to the application for explaining the application.In the accompanying drawings:
Fig. 1 is the flow chart of a kind of positioning sound source by robot that one embodiment of the application provides;
Fig. 2 a are the flow chart of another positioning sound source by robot that one embodiment of the application provides;
Fig. 2 b are the flow chart of another positioning sound source by robot that one embodiment of the application provides;
Fig. 2 c are the flow chart of another positioning sound source by robot that one embodiment of the application provides
Fig. 3 is the flow chart of a kind of positioning sound source by robot that another embodiment of the application provides;
Fig. 4 is the flow chart of another positioning sound source by robot that another embodiment of the application provides;
Fig. 5 is the flow chart of another positioning sound source by robot that another embodiment of the application provides;
Fig. 6 is the flow chart that the first boundary threshold, the second boundary threshold value and third boundary threshold is obtained ahead of time;
Fig. 7 is the structure diagram of a kind of robot that the another embodiment of the application provides.
Fig. 8 shows a kind of arrangement mode of two-dimentional microphone array;
Fig. 9 shows a kind of shape of robot.
Specific embodiment
Purpose, technical scheme and advantage to make the application are clearer, below in conjunction with the application specific embodiment and
Technical scheme is clearly and completely described in corresponding attached drawing.Obviously, described embodiment is only the application one
Section Example, instead of all the embodiments.Based on the embodiment in the application, those of ordinary skill in the art are not doing
Go out all other embodiments obtained under the premise of creative work, shall fall in the protection scope of this application.
Sound source can not be determined sometimes for the robot for carrying out auditory localization based on linear microphone array in the prior art
Positioned at the front of robot or rear, the problem of leading to not sound source is accurately positioned.The embodiment of the present application provides a kind of solution
Scheme:Two-dimentional microphone array in robot is set, passes through array element center the first microphone not on the same line and the
Acoustic energy between the two microphones when position relationship between two microphones, it may be determined that go out target sound source relative to machine
The orientation section of people, such as may determine that target sound source is located at the front or rear of robot, and then realizes and be accurately positioned
The actual position of target sound source.
Below in conjunction with attached drawing, the technical solution that each embodiment of the application provides is described in detail.
Fig. 1 is the flow chart of a kind of positioning sound source by robot that one embodiment of the application provides.It as shown in Figure 1, should
Method includes:
100th, according to the collected voice data from target sound source of the first microphone, calculate what the first microphone obtained
First sound energy value, wherein, the first microphone is that array element center is located at any in first straight line in two-dimentional microphone array
Microphone;
101st, according to the collected voice data from target sound source of second microphone, calculate what second microphone obtained
Second sound energy value, wherein, second microphone be in two-dimentional microphone array array element center and first straight line phase from Mike
Wind;
102nd, according to the first sound energy value and the energy ratio of second sound energy value and the first microphone and second
The position relationship of microphone determines orientation section of the target sound source relative to robot.
In the present embodiment, two-dimentional microphone array refers to the array that several microphones in one plane are formed, each
A microphone is the array element in array, is located at same straight line (i.e. first straight line) comprising array element center in two-dimentional microphone array
On several microphones and array element center and the straight line mutually from microphone.First microphone can be any on the straight line
Microphone, second microphone can be with the straight line mutually from any microphone.In addition, the plane where two-dimentional microphone array
It may be configured as parallel to the ground, may be alternatively provided as vertical with the rotary shaft of robot, may also be configured to other suitable angles certainly
Degree.
Fig. 8 shows a kind of arrangement mode of two-dimentional microphone array, as shown in figure 8, two-dimentional microphone array includes 4
Microphone M1, M2, M3 and M4, M1, M3 and M4 are located along the same line, and M2 and the straight line are mutually from can be using M1 as the first Mike
Wind, using M2 as second microphone.Certainly, the first microphone can also be M3 or M4.
It should be noted that Fig. 8 merely illustrates a kind of layout type of two-dimentional microphone array, and should not be used as
To the concrete restriction of number of microphone and layout in microphone array two-dimentional in the embodiment of the present application.According to different demands, two
Number of microphone in dimension microphone array can change, and the position relationship between microphone can also be adjusted according to demand
It is whole.Optionally, one or more groups of two-dimentional microphone arrays can be set in robot.
Two-dimentional microphone array is mainly used for acquiring voice data, and optionally, the microphone in two-dimentional microphone array can
Using the electret microphone of cardioid directivity.It, can be according to different Mikes based on the voice data of two-dimentional microphone array acquisition
Sound capabilities ratio between wind determines orientation section of the target sound source relative to robot.When target sound source makes a sound,
Microphone in two-dimentional microphone array can collect the voice data from target sound source.It, can be according to Mike in the present embodiment
Collected voice data calculates its sound energy value obtained to wind whithin a period of time.It is assumed that some microphone in a period of time
The voice data of acquisition contains N number of sampled point, then the microphone during this period of time corresponding sound of the collected voice data of institute
Sound energy value is:
Wherein, xiRepresenting the amplitude of ith sample point, N represents that the voice data of microphone acquisition contains sampled point number,
E represents the sound energy value that microphone obtains.
It accordingly, can be according to the sound of the first microphone and the second microphone collected target sound source in same amount of time
Data calculate the sound energy value that the first microphone and second microphone obtain, and based on the first microphone and the second Mike
The energy ratio of wind determines the distance of the first microphone and second microphone distance objective sound source.It is obtained when the first microphone
When sound energy value is more than the sound energy value that second microphone obtains, illustrate that the first microphone distance objective sound source is nearer, instead
It, then illustrate that second microphone distance objective sound source is nearer.
Based on above-mentioned, target sound source and the relative position relation of two-dimentional microphone array can be primarily determined out, but not yet really
The relative position relation of the sound source that sets the goal and robot.In the present embodiment, target sound source and the phase of microphone array are being determined
It, can be according to two-dimentional microphone array and the relative position relation namely the first microphone of robot on the basis of position relationship
Position relationship between second microphone determines orientation section of the target sound source relative to robot.
The relative position of two-dimentional microphone array and robot can that is to say the first microphone and the second wheat there are many form
The position relationship of gram wind can be there are many form, for example, first straight line can namely first microphone parallel with the shirtfront of robot
Set on robot thoracic cavity position, and second microphone is set on robot back position, and the first microphone is located at second in the form
In front of microphone;In another example first straight line can namely first microphone parallel with the back of robot be set on robot back position
It puts, and second microphone is set on robot thoracic cavity position, the first microphone is located at second microphone rear in the form;Example again
Such as, first straight line can namely first microphone parallel with the side of robot be set on robot lateral location, and second microphone
Set on the first microphone to side position, the first microphone is located at second microphone side, etc. in the form.In addition, with reference to
The line of a kind of layout type of two-dimentional microphone array shown in Fig. 8, second microphone and the first microphone can be with first directly
Line is vertical, certainly also can out of plumb.The embodiment of the present application does not limit this.
For the position relationship of the first microphone and second microphone to determining orientation of the target sound source relative to robot
The influence in section can carry out angle conversion by the position relationship to the first microphone under different form and second microphone,
Corresponding conversion scale is either multiplied by when calculating sound energy value or the definition by adjusting the orientation section of robot comes
It realizes unified.
Above-mentioned each example is accepted, when first straight line is parallel with the shirtfront of robot namely the first microphone is set on robot chest
Chamber position, and second microphone be set on robot back position when, however, it is determined that the first microphone of target sound source distance is nearer, then may be used
Determine that target sound source is located at the front (corresponding following forward direction section) of robot;When the back of first straight line and robot is put down
Row namely the first microphone be set on robot back position, and second microphone be set on robot thoracic cavity position when, however, it is determined that mesh
It is nearer to mark sound source the first microphone of distance, it is impossible to directly determine that target sound source is located at the front of robot again, and angle need to be carried out
Conversion can determine that target sound source is located at the rear (corresponding negative sense section hereinafter) of robot later.Hereinafter, by emphasis base
Robot thoracic cavity position is set in the first microphone, and the form that second microphone is set on robot back position carries out technical side
The detailed description of case.
In the embodiment of the present application, two-dimentional microphone array is set in robot, by array element center not in same straight line
On the first microphone and second microphone between the acoustic energy when position relationship between two microphones, it may be determined that go out
Target sound source such as can determine whether out that target sound source is located at the front or rear of robot relative to the orientation section of robot,
And then realize the actual position that target sound source is accurately positioned.
Fig. 2 a are the flow chart of another positioning sound source by robot that one embodiment of the application provides.Wherein, first
Microphone and second microphone are respectively arranged on robot thoracic cavity and back position.As shown in Fig. 2, this method includes:
200th, according to the collected voice data from target sound source of the first microphone, calculate what the first microphone obtained
First sound energy value, wherein, the first microphone is that array element center is located at any in first straight line in two-dimentional microphone array
Microphone;
201st, according to the collected voice data from target sound source of second microphone, calculate what second microphone obtained
Second sound energy value, wherein, second microphone be in two-dimentional microphone array array element center and first straight line phase from Mike
Wind;
202nd, when energy ratio is less than the first boundary threshold, determine that target sound source is located at the negative sense section of robot;
203rd, when energy ratio is more than the second boundary threshold value, determine that target sound source is located at the positive section of robot;
204th, when energy ratio is greater than or equal to the first boundary threshold and less than or equal to the second boundary threshold value, mesh is determined
Mark sound source is located at the lateral section of robot.
Method provided in this embodiment is suitable for robot, and two-dimentional microphone array, the first wheat are provided in the robot
Gram wind and second microphone are respectively arranged on robot thoracic cavity and back position, the orientation section of robot may include positive section,
Negative sense section and lateral section, positive section refer to be intended to the region in front of robot, and negative sense section refers to be intended to machine
The region at people rear, lateral section refer to be intended to the region of robot side.Certainly, in addition to provided in this embodiment this right
It answers outside mode, can also there be other corresponded manners in the orientation section of robot, for example, would tend to the definition of the region in front of robot
For negative sense section, and the region that would tend to robot rear is defined as positive section or using other name definition machine
The orientation section of device people, should all belong in the protection domain of the embodiment of the present application.
First boundary threshold is used to limit the energy ratio of corresponding first microphone in negative sense section and second microphone
Maximum value when the energy ratio of the first microphone and second microphone is less than the first boundary threshold, illustrates that the energy ratio is small
In the maximum value of the corresponding energy ratio in negative sense section, accordingly, it can be determined that target sound source is located at the negative sense section of robot.Second
Boundary threshold is used to limit the minimum value of the energy ratio of corresponding first microphone in positive section and second microphone, when first
When the energy ratio of microphone and second microphone is more than the second boundary threshold value, illustrate that the energy ratio is more than positive section and corresponds to
Energy ratio minimum value, accordingly, it can be determined that target sound source is located at the positive section of robot.And when the first microphone and the
When the energy ratio of two microphones is greater than or equal to the first boundary threshold and is less than or equal to the second boundary threshold value, illustrate, target
Sound source is neither located at positive section nor positioned at negative sense section, then can determine that target sound source is located at the lateral section of robot.Figure
2b is the flow chart of another positioning sound source by robot that one embodiment of the application provides.As shown in Figure 2 b, when determining mesh
When mark sound source is located at the lateral section of robot, positioning sound source by robot provided in this embodiment, including:
200th, according to the collected voice data from target sound source of the first microphone, calculate what the first microphone obtained
First sound energy value, wherein, the first microphone is that array element center is located at any in first straight line in two-dimentional microphone array
Microphone;
201st, according to the collected voice data from target sound source of second microphone, calculate what second microphone obtained
Second sound energy value, wherein, second microphone be in two-dimentional microphone array array element center and first straight line phase from Mike
Wind;
202nd, when energy ratio is less than the first boundary threshold, determine that target sound source is located at the negative sense section of robot;
203rd, when energy ratio is more than the second boundary threshold value, determine that target sound source is located at the positive section of robot;
204th, when energy ratio is greater than or equal to the first boundary threshold and less than or equal to the second boundary threshold value, mesh is determined
Mark sound source is located at the lateral section of robot;And perform step 205;
205th, the third microphone being located at according to array element center in first straight line and positioned at the first microphone side is acquired
The voice data from target sound source arrived calculates the third sound energy value that third microphone obtains;
206th, it when third sound energy value and the energy ratio of second sound energy value are more than third boundary threshold, determines
Target sound source is located at close to the lateral section of third microphone side;
207th, when third sound energy value and the energy ratio of second sound energy value are less than or equal to third boundary threshold
When, determine that target sound source is located remotely from the lateral section of third microphone side.
To judge that target sound source is located at the lateral section of which side, array element center can be chosen and be located in first straight line and be located at
Any microphone on the left of first microphone calculates the third acoustic energy of third microphone acquisition as third microphone
It is worth, technological means can refer to described above used by calculating energy value, and details are not described herein again.Wherein, third boundary threshold
Value is for limiting close to the corresponding third microphone in lateral section of third microphone side and the energy ratio of second microphone
Minimum value, when the energy ratio of third microphone and second microphone be more than third boundary threshold when, illustrate the energy ratio
More than the minimum value of the corresponding energy ratio in lateral section close to third microphone side, accordingly, it can be determined that target sound source position
In the lateral section of the close third microphone side of robot;When third sound energy value and the energy of second sound energy value
When ratio is less than or equal to third boundary threshold, it may be determined that target sound source is located remotely from the lateral section of third microphone side.
Similarly, to judge that target sound source is located at the lateral section of which side, it can also choose array element center and be located at first straight line
Above and any microphone on the right side of the first microphone is as third microphone, when third microphone and the energy of second microphone
When measuring ratio more than third boundary threshold, it may be determined that target sound source is located at the lateral section of the close third microphone side of robot
Between;When third sound energy value and the energy ratio of second sound energy value are less than or equal to third boundary threshold, it may be determined that
Target sound source is located remotely from the lateral section of third microphone side.So as to, it may be determined that go out target sound source be located at robot which
The lateral section of side.
Fig. 2 c are the flow chart of another positioning sound source by robot that one embodiment of the application provides.Such as Fig. 2 c institutes
Show, when determining that target sound source is located at the lateral section of robot, positioning sound source by robot provided in this embodiment, packet
It includes:
200th, according to the collected voice data from target sound source of the first microphone, calculate what the first microphone obtained
First sound energy value, wherein, the first microphone is that array element center is located at any in first straight line in two-dimentional microphone array
Microphone;
201st, according to the collected voice data from target sound source of second microphone, calculate what second microphone obtained
Second sound energy value, wherein, second microphone be in two-dimentional microphone array array element center and first straight line phase from Mike
Wind;
202nd, when energy ratio is less than the first boundary threshold, determine that target sound source is located at the negative sense section of robot;
203rd, when energy ratio is more than the second boundary threshold value, determine that target sound source is located at the positive section of robot;
204th, when energy ratio is greater than or equal to the first boundary threshold and less than or equal to the second boundary threshold value, mesh is determined
Mark sound source is located at the lateral section of robot;And perform step 208;
208th, calculating the 4th microphone that array element center is located in first straight line and the 5th microphone, currently acquisition comes from mesh
The delay inequality between the voice signal of sound source is marked, wherein, the 4th microphone and the 5th microphone are the arbitrary wheat in first straight line
Gram wind;
209th, when delay inequality is less than 0, determine that target sound source is located at close to the lateral section of the 4th microphone side;
2010th, when delay inequality is more than 0, determine that target sound source is located remotely from the lateral section of the 4th microphone side.
When the delay inequality between the 4th microphone and the 5th microphone currently voice signal of the acquisition from target sound source is small
When 0, illustrate that target sound source and the distance of the 4th microphone are less than target sound source and the 5th microphone, accordingly, it can be determined that mesh
Sound source is marked to be located at close to the lateral section of the 4th microphone side;Similarly, when the 4th microphone and the 5th microphone currently acquire
When delay inequality between voice signal from target sound source is more than 0, illustrate that target sound source and the distance of the 4th microphone are big
In target sound source and the 5th microphone, accordingly, it can be determined that target sound source is located remotely from the lateral section of the 4th microphone side.From
And, it may be determined that go out the lateral section that target sound source is located at robot which side.
It, can when the first microphone and second microphone are respectively arranged on robot thoracic cavity and back position in the present embodiment
Determine target sound source relative to robot according to preset first boundary threshold, the second boundary threshold value and third boundary threshold
Orientation section, the actual position so as to be accurately judged to target sound source are front, rear or the either side positioned at robot
Side.
Based on above-mentioned, it may be determined that go out orientation section of the target sound source relative to robot, it after this, can be according to determining
Orientation section, target sound source is accurately positioned.Below with reference to Fig. 3-5, it is located at different direction area for target sound source
Between situation, be described in detail to target sound source carry out precise positioning process.Fig. 3 is one kind that another embodiment of the application provides
The flow chart of positioning sound source by robot.As shown in figure 3, this method, including:
300th, according to the collected voice data from target sound source of the first microphone, calculate what the first microphone obtained
First sound energy value, wherein, the first microphone is that array element center is located at any in first straight line in two-dimentional microphone array
Microphone;
301st, according to the collected voice data from target sound source of second microphone, calculate what second microphone obtained
Second sound energy value, wherein, second microphone be in two-dimentional microphone array array element center and first straight line phase from Mike
Wind;
302nd, when energy ratio is less than the first boundary threshold, determine that target sound source is located at the negative sense section of robot;
303rd, when energy ratio is more than the second boundary threshold value, determine that target sound source is located at the positive section of robot;And
Perform step 305;
304th, when energy ratio is greater than or equal to the first boundary threshold and less than or equal to the second boundary threshold value, mesh is determined
Mark sound source is located at the lateral section of robot;
305th, several microphones being located at according to array element center in first straight line currently acquire the sound from target sound source
Delay inequality between signal is calculated and is adjusted the angle;
306th, when adjusting the angle more than 0 ° and no more than 90 °, using 90 ° with the difference of adjustment angle as final angle,
And robot is controlled to rotate clockwise final angle;
307th, it when adjusting the angle more than 90 ° and less than 180 °, will adjust the angle with 270 ° of difference as final angle,
And robot is controlled to rotate final angle counterclockwise.
The description as described in step 300-304 can be found in previous embodiment, and details are not described herein again.
It is adjusted the angle to calculate, several microphones that array element center is located in first straight line can be chosen, and selected by calculating
The current time delay between voice signal of the acquisition from target sound source of microphone, the microphone of selection can be in first straight line
Arbitrary microphone.For the microphone of selection, adjacent microphone can be used as one group, according to the time delay of microphone each in group,
The corresponding delay inequality of this group of microphone can be calculated, later, can be adjusted the angle based on the delay inequality calculating of several groups of microphones.One group
Spacing between interior microphone can be used as spacing in group, can direct root when spacing is equal in the group between each group microphone
It calculates and adjusts the angle according to the delay inequality of each group microphone;It, then can basis when spacing is unequal in the group between each group microphone
Difference or ratio in group between spacing convert to delay inequality, and are calculated and adjusted the angle according to the delay inequality after conversion.Separately
It outside, can be according to each group Mike if each group microphone is non-conterminous namely each group microphone does not include same microphone between any two
The distance between wind corrects delay inequality, and is calculated and adjusted the angle according to revised delay inequality.
Two-dimentional microphone array arrangement mode shown in Fig. 8 is accepted below, with based on the delay inequality between two groups of microphones
It calculates and is illustrated for adjusting the angle.
In Fig. 8, the spacing between M4 and M1 is equal to the spacing between M3 and M1, calculates the delay inequality τ of M4 and M1 first41,
And the delay inequality τ of M3 and M131, can be obtained further according to following formula (one) and adjust the angle α:
Wherein, spacing of the d between microphone, c are the velocity of sound in air.
Since target sound source is located at the square section of robot, as 0 < α≤90, robot rotates clockwise
(90- α) is spent, you can face target sound source;As 90 < α < 180, robot rotates counterclockwise (α -90) degree, you can face mesh
Mark sound source.It can realize accordingly and target sound source is accurately positioned.
Fig. 4 is the flow chart of another positioning sound source by robot that another embodiment of the application provides.Such as Fig. 4 institutes
Show, this method includes:
400th, according to the collected voice data from target sound source of the first microphone, calculate what the first microphone obtained
First sound energy value, wherein, the first microphone is that array element center is located at any in first straight line in two-dimentional microphone array
Microphone;
401st, according to the collected voice data from target sound source of second microphone, calculate what second microphone obtained
Second sound energy value, wherein, second microphone be in two-dimentional microphone array array element center and first straight line phase from Mike
Wind;
402nd, when energy ratio is less than the first boundary threshold, determine that target sound source is located at the negative sense section of robot;And
Perform step 405;
403rd, when energy ratio is more than the second boundary threshold value, determine that target sound source is located at the positive section of robot;
404th, when energy ratio is greater than or equal to the first boundary threshold and less than or equal to the second boundary threshold value, mesh is determined
Mark sound source is located at the lateral section of robot;
405th, several microphones being located at according to array element center in first straight line currently acquire the sound from target sound source
Delay inequality between signal calculates coarse adjustment angle;
406th, when coarse adjustment angle is more than 0 ° and no more than 90 °, using coarse adjustment angle with the sum of 90 ° as final angle, and
Control robot rotates clockwise final angle;
407th, when coarse adjustment angle is more than 90 ° and less than 180 °, using 270 ° with the difference of coarse adjustment angle as final angle,
And robot is controlled to rotate final angle counterclockwise.
The description as described in step 400-404 can be found in previous embodiment, and details are not described herein again.
Wherein, the process for calculating coarse adjustment angle can refer to above, since target sound source is located at the negative sense section of robot, because
This, as 0 < α≤90, robot rotates clockwise (90+ α) degree, you can face target sound source;As 90 < α < 180, machine
People rotates counterclockwise (270- α) degree, you can face target sound source.
Under some scenes, since the sound scattering of robot body influences, when target sound source is located at the negative sense area of robot
Between when the precision of coarse adjustment angle [alpha] that directly calculates, will be less than target sound source and be located at what is calculated during the positive section of robot
The precision of coarse adjustment angle [alpha], therefore, the final angle based on coarse adjustment angle calculation are possible and inaccurate.Accordingly, in control robot
Clockwise or counterclockwise after final angle, as shown in figure 4, the positioning sound source by robot, further includes:
408th, several microphones being located at according to array element center in first straight line currently acquire the sound from target sound source
Delay inequality between signal calculates vernier angle;
409th, according to vernier angle, control robot is rotated to face target sound source.
About the process according to the rotation of vernier angle control robot, can refer to above when determining that target sound source is located at machine
After device people's forward direction section, according to the process for adjusting the angle the rotation of control robot, details are not described herein again.
After control robot clockwise or counterclockwise final angle, target sound source will be positioned at the forward region of robot
Between, at this point, a vernier angle is calculated further according to Chinese style above (one), and again according to the rotation of vernier angle control robot, it can
Ensure postrotational robot face target sound source again, this greatly improves the accuracy positioned to target sound source.
Fig. 5 is the flow chart of another positioning sound source by robot that another embodiment of the application provides.Such as Fig. 5 institutes
Show, this method includes:
500th, according to the collected voice data from target sound source of the first microphone, calculate what the first microphone obtained
First sound energy value, wherein, the first microphone is that array element center is located at any in first straight line in two-dimentional microphone array
Microphone;
501st, according to the collected voice data from target sound source of second microphone, calculate what second microphone obtained
Second sound energy value, wherein, second microphone be in two-dimentional microphone array array element center and first straight line phase from Mike
Wind;
502nd, when energy ratio is less than the first boundary threshold, determine that target sound source is located at the negative sense section of robot;And
Perform step 505
503rd, when energy ratio is more than the second boundary threshold value, determine that target sound source is located at the positive section of robot;
504th, when energy ratio is greater than or equal to the first boundary threshold and less than or equal to the second boundary threshold value, mesh is determined
Mark sound source is located at the lateral section of robot;
505th, control robot rotates 180 °;
506th, several microphones being located at according to array element center in first straight line currently acquire the sound from target sound source
Delay inequality between signal is calculated and is adjusted the angle;
507th, it is rotated according to adjustment angle control robot to face target sound source.
The description as described in step 500-504 can be found in previous embodiment, and details are not described herein again.
Since target sound source is located at the negative sense section of robot, and negative sense section and positive section are symmetrical, therefore, can be first
Robot is controlled to rotate 180 °, target sound source is located at the positive section of robot at this time, hereafter, based on postrotational robot position
It puts, then performs and pinpoint mistake above is carried out to target sound source when determining that target sound source is located at robot forward direction section
Journey, can avoid influence of the sound scattering due to robot body to result of calculation, reduce calculation amount, so as to rapidly realize pair
Target sound source is accurately positioned.
After determining that target sound source is located at the lateral section of robot, when target sound source is located remotely from third microphone one
During the lateral section of side, robot can be rotated by 90 ° to the first microphone side;When target sound source is located at close to third Mike
During the lateral section of wind side, the side of robot to third microphone can be rotated by 90 °.After this rotation, target sound source will
Positioned at the positive section of robot, it is contemplated that influence of the sound scattering of robot body to result of calculation can be rotated in robot
Afterwards, according to above carrying out pinpoint process to target sound source when determining that target sound source is located at robot forward direction section,
So as to correct the rotation angle of robot, target sound source is accurately positioned with realizing.
In above-mentioned or following each embodiments, the first boundary threshold, the second boundary threshold value and third boundary threshold can be according to
It sets according to experience or is set after being debugged according to different robots and/or different two-dimentional microphone arrays,
The process debugged below with reference to Fig. 6 detailed descriptions to the first boundary threshold, the second boundary threshold value and third boundary threshold.
Fig. 6 is the flow chart that the first boundary threshold, the second boundary threshold value and third boundary threshold is obtained ahead of time.Such as Fig. 6 institutes
Show, which includes:
600th, according to the position relationship between microphone in two-dimentional microphone array, the orientation section of robot is divided into
Positive section, negative sense section and lateral section;
601st, according to the first microphone and second microphone several predetermined angles in negative sense section and positive section respectively
The upper collected voice data from measuring sound source calculates negative sense section energy corresponding with predetermined angle each in positive section
Amount compares test value;
602nd, it is come from according to third microphone and second microphone are collected in several predetermined angles in lateral section
The voice data of measuring sound source calculates the corresponding energy ratio test value of each predetermined angle in lateral section;Wherein, measuring sound source
It is moved around robot;
603rd, respectively by the corresponding energy ratio test value of predetermined angle each in negative sense section, normal interval and lateral section
In maximum energy ratio test value as the first boundary threshold, the second boundary threshold value and third boundary threshold.
The process debugged to the first boundary threshold, the second boundary threshold value and third boundary threshold can be in foregoing embodiments
In step 102 before perform, other steps about positioning sound source by robot provided by the embodiments of the present application can refer to
Description in each embodiment above is not showed that in Fig. 6, is repeated no more herein yet.
It, can be according to the position between microphone in two-dimentional microphone array in order to realize the division in the orientation section of robot
Plane residing for two-dimentional microphone array or space are divided into positive area, negative area and side zones, then root by relationship
According to the relative position of two-dimentional microphone array and robot, the positive section, negative sense section and lateral section of robot are defined.
For example, can using first straight line as line of demarcation, by the plane where two-dimentional microphone array be divided into positive area,
Negative area and side zones, first straight line both sides are respectively as positive area and negative area, the area where first straight line
Domain as side zones, wherein, can be using the region where second microphone as negative area.
In some scenes, when first straight line is parallel with the shirtfront of robot, and the first microphone be located at precordial locations and
When second microphone is located at robot back position, it will directly can be extended to based on the region divided in plane to the both sides of plane
Spatial Dimension, so as to which the corresponding space in positive area to be determined as to the positive section of robot, by the corresponding space of negative area
It is determined as the negative sense section of robot, the corresponding space of side zones is determined as to the lateral section of robot.
In other scenes, when first straight line is parallel with the shirtfront of robot, and second microphone is located at precordial locations
And the first microphone will directly can be extended based on the region divided in plane to the both sides of plane when being located at robot back position
To Spatial Dimension, and the corresponding space in positive area is determined as to the negative sense section of robot, by the corresponding space of negative area
It is determined as the positive section of robot, the corresponding space of side zones is determined as to the lateral section of robot.
Certainly, between microphone may be other position relationships in two-dimentional microphone array in another scene, for
A variety of position relationships in two-dimentional microphone array between microphone, the region that plane where two-dimentional microphone array can be divided
Angle conversion is carried out, to correspond to each orientation section of robot, so as to fulfill the division in the orientation section of robot.Separately
Outside, other manner also can be used to the plane where two-dimentional microphone array to divide, can assists realizing the side of robot
The mode of position interval division should all belong to the scope of protection of the present invention interior.
Robot thoracic cavity position is set below or with the first microphone, and second microphone is set on robot back position
Situation illustrate.
After the arrangement mode and the relative position of two-dimentional microphone and robot of two-dimentional microphone array determine, it is based on
The orientation section of ready-portioned robot can be used measuring sound source and play a section audio, and measuring sound source is moved around robot, is
The each orientation section of acquisition corresponding boundary threshold, can set several predetermined angles, predetermined angle in each orientation section
It will be as the sampled point in debugging process.Predetermined angle can be several fixed angles, for example, being with the angle between first
10 °, 30 °, 60 °, 90 °, 110 ° etc. angularly;Or predetermined angle can be determining angle with fixed angle interval,
For example, using one end of first straight line as 0 ° of starting point, each 15 ° are set as a predetermined angle, and the orientation section of robot will have
There are 24 predetermined angles.Certainly, other manner setting predetermined angle also can be used, as long as being capable of providing the more of each orientation section
A sampled value.
When measuring sound source is moved to predetermined angle, can according to the first microphone and second microphone respectively it is collected come
The voice data of self-test sound source calculates the sound energy value of the first microphone and second microphone, and is obtained based on calculating respectively
The first microphone and the sound energy value of second microphone obtained calculates the first microphone and the energy ratio of second microphone is tested
Value.The energy that each predetermined angle in positive section and negative sense section will correspond to first microphone and second microphone
Than test value, according to the predetermined angle that positive section is included, corresponding energy ratio test value can be based on and generate positive Interval Set
It closes;According to the predetermined angle that negative sense section is included, corresponding energy ratio test value generation negative sense section set can be based on, it will be negative
Maximum value into section set is as the first boundary threshold, and the minimum value during positive section is gathered is as the second boundary threshold
Value.
Based on the first boundary value and the second boundary threshold value of the setting of above-mentioned debugging process, since the first boundary threshold is positive
The maximum energy ratio test value of corresponding first microphone in section and second microphone, therefore, is determining that target sound source is opposite
When the orientation section of robot, if the energy ratio of the first microphone and second microphone is less than the first boundary threshold, you can
Determine that target sound source is located at the positive section of robot.Similarly, since the second boundary threshold value is corresponding first wheat in negative sense section
The minimum energy ratio test value of gram wind and second microphone, therefore, is determining azimuthal bin of the target sound source relative to robot
Between when, if the energy ratio of the first microphone and second microphone be more than the first boundary threshold, you can determine that target sound source is located at
The negative sense section of robot.And if the energy ratio of the first microphone and second microphone is greater than or equal to the first boundary threshold
Or less than or equal to the second boundary threshold value, then it can determine target sound source neither in the positive section of robot nor in robot
Negative sense section, but in the lateral section of robot.
In order to further be divided to the lateral section of robot, any microphone of the first microphone side can be chosen
As third microphone, and according to third microphone and second microphone in lateral section in several predetermined angles it is collected
Voice data from measuring sound source calculates the corresponding energy ratio test value of each predetermined angle in lateral section.Lateral section
In each predetermined angle will a corresponding third microphone and second microphone energy ratio test value, according to lateral section
Comprising predetermined angle, corresponding energy ratio test value can be based on and generate lateral section set, will be in the set of lateral section
Minimum value is as third boundary threshold.
Based on the third boundary threshold of above-mentioned debugging process setting, since third boundary threshold is that lateral section is corresponding
The minimum energy ratio test value of third microphone and second microphone, therefore, in the side for determining target sound source and being located at robot
Behind section, if the energy ratio of third microphone and second microphone is less than third boundary threshold, you can determine target sound source
Positioned at the lateral section of close third microphone side, if third sound energy value and the energy ratio of second sound energy value
During less than or equal to third boundary threshold, you can determine that target sound source is located at and lean on the lateral section far from third microphone side.
In the present embodiment, since the body of robot has sound scattering, in order to more reasonably divide robot
Orientation section can assist carrying out the division in orientation section by above-mentioned predetermined angle.First using the first microphone as origin,
It is spaced according to predetermined angle in the plane where two-dimentional microphone array and determines predetermined angle, it will be two-dimentional further according to predetermined angle
Plane where microphone array is divided into multiple predeterminable areas, chooses positive area, negative area and side zones again later
Corresponding predeterminable area finally determines the forward direction of robot respectively according to positive area, negative area and side zones
Section, negative sense section and lateral section.
With reference to the arrangement mode of two-dimentional microphone array shown in Fig. 8, based on two-dimensional coordinate system, (0,0), (0 ,-m),
(m, 0) and (- m, 0) position is respectively arranged with microphone, wherein, the first microphone is located at (0,0) position, and second microphone is located at
(0 ,-m) position, straight line are X-axis, and the corresponding angle of X-axis positive direction is 0 °, the mistake divided to the orientation section of robot
Journey, it may include:
Since 0 °, each predetermined angle is determined according to predetermined angle interval;
By the region between 0 ° to 180 ° between first and the last one predetermined angle, it is determined as positive section;
By the region between 180 ° to 360 ° between first and the last one predetermined angle, it is determined as negative sense section;
0 ° and 180 ° are identified as lateral section.
For example, when predetermined angle is 15 °, it can be using the area of space between 15 ° -165 ° as the forward region of robot
Between, it can be using the area of space between 195 ° -345 ° as the negative sense section of robot.
In another example when predetermined angle is 10 °, it can be using the area of space between 10 ° -170 ° as the forward region of robot
Between, it can be using the area of space between 190 ° -350 ° as the negative sense section of robot
In the present embodiment, according to different robots and/or different two-dimentional microphone arrays, the first boundary threshold is determined
Value, the second boundary threshold value and third boundary threshold can be to determine that target sound source is carried relative to the process in the orientation section of robot
For accurately judgement basis, so as to improve the accuracy positioned to target sound source.
Fig. 7 is the structure diagram of a kind of robot that the another embodiment of the application provides, as shown in fig. 7, the robot
Including basic machine 00, memory 70, processor 71 and two-dimentional microphone array 72 are provided on basic machine 00:
Two-dimentional microphone array 72 includes the first microphone and second microphone, and the first microphone is two-dimentional microphone array
Middle array element center is located at any microphone in first straight line, and second microphone is array element center and the in two-dimentional microphone array
One straight line mutually from microphone;
Memory 70 can be configured as storing other various data to support to set in server in storage computer program
Standby upper operation.The example of these data includes any application program or the finger of method for being operated on server apparatus
It enables, contact data, telephone book data, message, picture, video etc..
Memory 70 is realized by any kind of volatibility or non-volatile memory device or combination thereof, such as static
Random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), Erasable Programmable Read Only Memory EPROM
(EPROM), programmable read only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, disk or light
Disk.
Processor 71 is coupled with memory 70, for performing the computer program in memory 70, for:
According to the collected voice data from target sound source of the first microphone, the first microphone obtains first is calculated
Sound energy value, wherein, the first microphone is that array element center is located at any Mike in first straight line in two-dimentional microphone array
Wind;
According to the collected voice data from target sound source of second microphone, second microphone obtains second is calculated
Sound energy value, wherein, second microphone be in two-dimentional microphone array array element center and first straight line phase from microphone;
According to the energy ratio and the first microphone of the first sound energy value and second sound energy value and the second Mike
The position relationship of wind determines orientation section of the target sound source relative to robot.
In the embodiment of the present application, based on the two-dimentional microphone array being arranged in robot, by the first microphone and
Acoustic energy between second microphone when position relationship, it may be determined that go out orientation section of the target sound source relative to robot,
Therefore, it can determine whether out that target sound source is located at the front or rear of robot, and then realizes and the true of target sound source is accurately positioned
Position.
In an alternative embodiment, the first microphone and second microphone are respectively arranged on robot thoracic cavity and back position,
Processor 71 is according to the energy ratio between the first sound energy value and second sound energy value and the first microphone and
The position relationship of two microphones when determining orientation section of the target sound source relative to robot, is specifically used for:
When energy ratio is less than the first boundary threshold, determine that target sound source is located at the negative sense section of robot;
When energy ratio is more than the second boundary threshold value, determine that target sound source is located at the positive section of robot;
When energy ratio is greater than or equal to the first boundary threshold and is less than or equal to the second boundary threshold value, target sound is determined
Source is located at the lateral section of robot.
In an alternative embodiment, processor 71 is also used after determining that target sound source is located at the lateral section of robot
In:
The third microphone institute for being located in first straight line according to array element center and being located at the first microphone side is collected
Voice data from target sound source calculates the third sound energy value that third microphone obtains;
When third sound energy value and the energy ratio of second sound energy value are more than third boundary threshold, target is determined
Sound source is located at close to the lateral section of the first microphone side;
When third sound energy value and the energy ratio of second sound energy value are less than or equal to third boundary threshold, really
The sound source that sets the goal is located remotely from the lateral section of third microphone side.
In an alternative embodiment, processor 71 is also used after determining that target sound source is located at the lateral section of robot
In:
Calculating the 4th microphone that array element center is located in first straight line and the 5th microphone, currently acquisition comes from target sound
Delay inequality between the voice signal in source, wherein, the 4th microphone and the 5th microphone are the arbitrary microphone in first straight line;
When delay inequality is less than 0, determine that target sound source is located at close to the lateral section of the 4th microphone side;
When delay inequality is more than 0, determine that target sound source is located remotely from the lateral section of the 4th microphone side.
In an alternative embodiment, after determining that target sound source is located at the negative sense section of robot, processor 71 is also used
In:
Robot is controlled to rotate 180 °;
Several microphones being located at according to array element center in first straight line currently acquire the voice signal from target sound source
Between delay inequality, calculate adjust the angle;
It is rotated according to control robot is adjusted the angle to face target sound source.
In an alternative embodiment, after determining that target sound source is located at the negative sense section of robot, processor 71 is also used
In:
Several microphones being located at according to array element center in first straight line currently acquire the voice signal from target sound source
Between delay inequality, calculate coarse adjustment angle;
When coarse adjustment angle is more than 0 ° and is not more than 90 °, using coarse adjustment angle with the sum of 90 ° as final angle, and control
Robot rotates clockwise final angle;
When coarse adjustment angle is more than 90 ° and during less than 180 °, using 270 ° with the difference of coarse adjustment angle as final angle, and control
Robot inverse hour hands processed rotate final angle.
In an alternative embodiment, processor 71 is after control robot clockwise or counterclockwise final angle, tool
Body is used for:
Several microphones being located at according to array element center in first straight line currently acquire the voice signal from target sound source
Between delay inequality, calculate vernier angle;
According to vernier angle, control robot is rotated to face target sound source.
In an alternative embodiment, after determining that target sound source is located at the positive section of robot, processor 71 is also used
In:
Several microphones being located at according to array element center in first straight line currently acquire the voice signal from target sound source
Between delay inequality, calculate adjust the angle;
When adjusting the angle more than 0 ° and no more than 90 °, 90 ° and are controlled with the difference of adjustment angle as final angle
Robot processed rotates clockwise final angle;
When adjusting the angle more than 90 ° and being less than 180 °, the difference with 270 ° will be adjusted the angle as final angle, and control
Robot inverse hour hands processed rotate final angle.
In an alternative embodiment, in the energy ratio according to the first sound energy value and second sound energy value, determine
Before orientation section belonging to target sound source, processor 71 is additionally operable to:
According to the position relationship between microphone in two-dimentional microphone array, the orientation section of robot is divided into forward direction
Section, negative sense section and lateral section;
It is adopted in several predetermined angles in negative sense section and positive section respectively according to the first microphone and second microphone
The voice data from measuring sound source collected calculates negative sense section energy ratio corresponding with predetermined angle each in positive section
Test value;
According to third microphone and second microphone in lateral section in several predetermined angles it is collected come self-test
The voice data of sound source calculates the corresponding energy ratio test value of each predetermined angle in lateral section;Wherein, measuring sound source is surround
Robot moves;
It respectively will be in the corresponding energy ratio test value of predetermined angle each in negative sense section, normal interval and lateral section
Maximum energy ratio test value is as the first boundary threshold, the second boundary threshold value and third boundary threshold.
In an alternative embodiment, based on two-dimensional coordinate system, distinguish in (0,0), (0 ,-m), (m, 0) and (- m, 0) position
Microphone is provided with, wherein, the first microphone is located at (0,0) position, and second microphone is located at (0 ,-m) position, and straight line is X-axis,
The corresponding angle of X-axis positive direction is 0 °, and processor is according to the position relationship between microphone in two-dimentional microphone array, by machine
When the orientation section of device people is divided into positive section, negative sense section and lateral section, it is specifically used for:
Since 0 °, each predetermined angle is determined according to predetermined angle interval;
By the region between 0 ° to 180 ° between first and the last one predetermined angle, it is determined as positive section;
By the region between 180 ° to 360 ° between first and the last one predetermined angle, it is determined as negative sense section;
0 ° and 180 ° are identified as lateral section.
Further, as shown in fig. 7, the robot further includes:Communication component 73, display 74, power supply module 75 etc. are other
Component.Members are only schematically provided in Fig. 7, are not meant to that robot only includes component shown in Fig. 7.
Wherein, wired or wireless side between equipment and other equipment where communication component 73 is configured to facilitate communication component
The communication of formula.Equipment where communication component can access the wireless network based on communication standard, such as WiFi, 2G or 3G or they
Combination.In one exemplary embodiment, communication component is received via broadcast channel from the wide of external broadcasting management system
Broadcast signal or broadcast related information.In one exemplary embodiment, the communication component further includes near-field communication (NFC) mould
Block, to promote short range communication.For example, radio frequency identification (RFID) technology, Infrared Data Association (IrDA) skill can be based in NFC module
Art, ultra wide band (UWB) technology, bluetooth (BT) technology and other technologies are realized.
Wherein, display 74 includes screen, and screen can include liquid crystal display (LCD) and touch panel (TP).Such as
Fruit screen includes touch panel, and screen may be implemented as touch screen, to receive input signal from the user.Touch panel packet
One or more touch sensors are included to sense the gesture on touch, slide, and touch panel.The touch sensor can not
The boundary of a touch or slide action is only sensed, but also detects duration associated with the touch or slide operation and pressure
Power.
Wherein, power supply module 75, the various assemblies of equipment provide electric power where power supply module.Power supply module can include
Power-supply management system, one or more power supplys and other are related to for equipment generation, management and distribution electric power where power supply module
The component of connection.
Fig. 9 shows a kind of shape of robot.Robot shape in the embodiment of the present application can there are many form, examples
Such as, the humanoid robot shown in Fig. 9, can also be other forms certainly.
Correspondingly, the embodiment of the present application also provides a kind of computer readable storage medium for being stored with computer program, meter
Calculation machine program is performed each step that can be realized and can be performed in above method embodiment by robot.
It should be understood by those skilled in the art that, embodiments herein can be provided as method, system or computer program
Product.Therefore, the reality in terms of complete hardware embodiment, complete software embodiment or combination software and hardware can be used in the application
Apply the form of example.Moreover, the computer for wherein including computer usable program code in one or more can be used in the application
The computer program production that usable storage medium is implemented on (including but not limited to magnetic disk storage, CD-ROM, optical memory etc.)
The form of product.
The application is with reference to the flow according to the method for the embodiment of the present application, equipment (system) and computer program product
Figure and/or block diagram describe.It should be understood that it can be realized by computer program instructions every first-class in flowchart and/or the block diagram
The combination of flow and/or box in journey and/or box and flowchart and/or the block diagram.These computer programs can be provided
The processor of all-purpose computer, special purpose computer, Embedded Processor or other programmable data processing devices is instructed to produce
A raw machine so that the instruction performed by computer or the processor of other programmable data processing devices is generated for real
The device of function specified in present one flow of flow chart or one box of multiple flows and/or block diagram or multiple boxes.
These computer program instructions, which may also be stored in, can guide computer or other programmable data processing devices with spy
Determine in the computer-readable memory that mode works so that the instruction generation being stored in the computer-readable memory includes referring to
Enable the manufacture of device, the command device realize in one flow of flow chart or multiple flows and/or one box of block diagram or
The function of being specified in multiple boxes.
These computer program instructions can be also loaded into computer or other programmable data processing devices so that counted
Series of operation steps are performed on calculation machine or other programmable devices to generate computer implemented processing, so as in computer or
The instruction offer performed on other programmable devices is used to implement in one flow of flow chart or multiple flows and/or block diagram one
The step of function of being specified in a box or multiple boxes.
In a typical configuration, computing device includes one or more processors (CPU), input/output interface, net
Network interface and memory.
Memory may include computer-readable medium in volatile memory, random access memory (RAM) and/or
The forms such as Nonvolatile memory, such as read-only memory (ROM) or flash memory (flash RAM).Memory is computer-readable medium
Example.
Computer-readable medium includes permanent and non-permanent, removable and non-removable media can be by any method
Or technology come realize information store.Information can be computer-readable instruction, data structure, the module of program or other data.
The example of the storage medium of computer includes, but are not limited to phase transition internal memory (PRAM), static RAM (SRAM), moves
State random access memory (DRAM), other kinds of random access memory (RAM), read-only memory (ROM), electric erasable
Programmable read only memory (EEPROM), fast flash memory bank or other memory techniques, CD-ROM read-only memory (CD-ROM),
Digital versatile disc (DVD) or other optical storages, magnetic tape cassette, the storage of tape magnetic rigid disk or other magnetic storage apparatus
Or any other non-transmission medium, available for storing the information that can be accessed by a computing device.It defines, calculates according to herein
Machine readable medium does not include temporary computer readable media (transitory media), such as data-signal and carrier wave of modulation.
It should also be noted that, term " comprising ", "comprising" or its any other variant are intended to nonexcludability
Comprising so that process, method, commodity or equipment including a series of elements are not only including those elements, but also wrap
Include other elements that are not explicitly listed or further include for this process, method, commodity or equipment it is intrinsic will
Element.In the absence of more restrictions, the element limited by sentence "including a ...", it is not excluded that wanted including described
Also there are other identical elements in the process of element, method, commodity or equipment.
The foregoing is merely embodiments herein, are not limited to the application.For those skilled in the art
For, the application can have various modifications and variations.All any modifications made within spirit herein and principle are equal
Replace, improve etc., it should be included within the scope of claims hereof.
Claims (11)
1. a kind of positioning sound source by robot, which is characterized in that, the method includes:
According to the collected voice data from target sound source of the first microphone, first microphone obtains first is calculated
Sound energy value, wherein, first microphone is that array element center is located at any in first straight line in two-dimentional microphone array
Microphone;
According to the collected voice data from the target sound source of second microphone, calculate what the second microphone obtained
Second sound energy value, wherein, the second microphone is array element center in the two-dimentional microphone array and described first straight
Line mutually from microphone;
According to the energy ratio of first sound energy value and the second sound energy value and first microphone with
The position relationship of the second microphone determines orientation section of the target sound source relative to the robot.
2. according to the method described in claim 1, it is characterized in that, first microphone and the second microphone are set respectively
In the robot thoracic cavity and back position;It is described according between first sound energy value and the second sound energy value
Energy ratio and first microphone and the second microphone position relationship, determine the target sound source relative to
The orientation section of the robot, including:
When the energy ratio is less than the first boundary threshold, determine that the target sound source is located at the negative sense area of the robot
Between;
When the energy ratio is more than the second boundary threshold value, determine that the target sound source is located at the forward region of the robot
Between;
When the energy ratio is greater than or equal to the first boundary threshold and is less than or equal to the second boundary threshold value, the mesh is determined
Mark sound source is located at the lateral section of the robot.
3. according to the method described in claim 2, it is characterized in that, in the side for determining the target sound source and being located at the robot
After section, the method further includes:
It is acquired according to the third microphone that array element center is located in the first straight line and positioned at the first microphone side
The voice data from the target sound source arrived calculates the third sound energy value that the third microphone obtains;
When the third sound energy value and the energy ratio of the second sound energy value are more than third boundary threshold, determine
The target sound source is located at close to the lateral section of the third microphone side;
When the third sound energy value and the energy ratio of the second sound energy value are less than or equal to the third boundary
During threshold value, determine that the target sound source is located remotely from the lateral section of the third microphone side.
4. according to the method described in claim 2, it is characterized in that, in the side for determining the target sound source and being located at the robot
After section, the method further includes:
Calculating the 4th microphone that array element center is located in the first straight line and the 5th microphone, currently acquisition comes from the mesh
The delay inequality between the voice signal of sound source is marked, wherein, the 4th microphone and the 5th microphone is in the first straight lines
Arbitrary microphone;
When the delay inequality is less than 0, determine that the target sound source is located at close to the lateral section of the 4th microphone side;
When the delay inequality is more than 0, determine that the target sound source is located remotely from the lateral section of the 4th microphone side.
5. according to the method described in claim 2, it is characterized in that, determining that the target sound source is located at the negative of the robot
After section, the method further includes:
The robot is controlled to rotate 180 °;
Several microphones being located at according to array element center in the first straight line currently acquire the sound from the target sound source
Delay inequality between signal is calculated and is adjusted the angle;
The robot is controlled to rotate to target sound source described in face according to described adjust the angle.
6. according to the method described in claim 2, it is characterized in that, determining that the target sound source is located at the negative of the robot
After section, the method further includes:
Several microphones being located at according to array element center in the first straight line currently acquire the sound from the target sound source
Delay inequality between signal calculates coarse adjustment angle;
When the coarse adjustment angle is more than 0 ° and is not more than 90 °, using the coarse adjustment angle with the sum of 90 ° as final angle, and
The robot is controlled to rotate clockwise the final angle;
When the coarse adjustment angle is more than 90 ° and during less than 180 °, using 270 ° with the difference of the coarse adjustment angle as final angle,
And the robot inverse hour hands is controlled to rotate the final angle.
7. according to the method described in claim 6, it is characterized in that, controlling institute clockwise or counterclockwise of the robot
After stating final angle, the method further includes:
Several microphones being located at according to array element center in the first straight line currently acquire the sound from the target sound source
Delay inequality between signal calculates vernier angle;
According to the vernier angle, the robot is controlled to rotate to target sound source described in face.
8. according to the method described in claim 2, it is characterized in that, determining that the target sound source is being located at the robot just
After section, the method further includes:
Several microphones being located at according to array element center in the first straight line currently acquire the sound from the target sound source
Delay inequality between signal is calculated and is adjusted the angle;
It is adjusted the angle when described more than 0 ° and during no more than 90 °, using 90 ° with the difference of the adjustment angle as final angle,
And the robot is controlled to rotate clockwise the final angle;
When the adjustment angle is more than 90 ° and is less than 180 °, the difference with 270 ° will be adjusted the angle as final angle, and control
It makes the robot inverse hour hands and rotates the final angle.
9. according to the method described in claim 1-8, which is characterized in that according to first sound energy value and described second
The energy ratio of sound energy value, before determining the orientation section belonging to target sound source, the method further includes:
According to the position relationship between microphone in the two-dimentional microphone array, the orientation section of the robot is divided into
Positive section, negative sense section and lateral section;
It is preset according to first microphone and the second microphone are several in the negative sense section and positive section respectively
The collected voice data from measuring sound source in angle calculates each predetermined angle in the negative sense section and positive section
Corresponding energy ratio test value;
It is come from according to third microphone and the second microphone are collected in several predetermined angles in the lateral section
The voice data of measuring sound source calculates the corresponding energy ratio test value of each predetermined angle in the lateral section;Wherein, it is described
Measuring sound source is moved around the robot;
It respectively will be in the corresponding energy ratio test value of predetermined angle each in the negative sense section, normal interval and lateral section
Maximum energy ratio test value is as the first boundary threshold, the second boundary threshold value and third boundary threshold.
10. according to the method described in claim 9, it is characterized in that, based on two-dimensional coordinate system, in (0,0), (0 ,-m), (m, 0)
And (- m, 0) position is respectively arranged with microphone, wherein, first microphone is located at (0,0) position, the second microphone
Positioned at (0 ,-m) position, the straight line is the X-axis, and the corresponding angle of X-axis positive direction is 0 °, described according to the two-dimentional Mike
Position relationship in wind array between microphone, by the orientation section of the robot be divided into positive section, negative sense section and
Lateral section, including:
Since 0 °, each predetermined angle is determined according to predetermined angle interval;
By the region between 0 ° to 180 ° between first and the last one predetermined angle, it is determined as positive section;
By the region between 180 ° to 360 ° between first and the last one predetermined angle, it is determined as negative sense section;
0 ° and 180 ° are identified as lateral section.
11. a kind of robot, which is characterized in that including:Basic machine is provided with memory, processor on the basic machine
With two-dimentional microphone array;
The two dimension microphone array includes microphone and array element center and described first that array element center is located in first straight line
Straight line mutually from microphone;
The memory, for storing computer program;
The processor, for performing the computer program, for:
According to the collected voice data from target sound source of the first microphone, first microphone obtains first is calculated
Sound energy value, wherein, first microphone is located at any microphone in first straight line for array element center;
According to the collected voice data from the target sound source of second microphone, calculate what the second microphone obtained
Second sound energy value, wherein, the second microphone for array element center and the first straight line phase from microphone;
According to the energy ratio of first sound energy value and the second sound energy value and first microphone with
The position relationship of the second microphone determines orientation section of the target sound source relative to the robot.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201810330841.7A CN108254721A (en) | 2018-04-13 | 2018-04-13 | A kind of positioning sound source by robot and robot |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201810330841.7A CN108254721A (en) | 2018-04-13 | 2018-04-13 | A kind of positioning sound source by robot and robot |
Publications (1)
Publication Number | Publication Date |
---|---|
CN108254721A true CN108254721A (en) | 2018-07-06 |
Family
ID=62748233
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201810330841.7A Pending CN108254721A (en) | 2018-04-13 | 2018-04-13 | A kind of positioning sound source by robot and robot |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN108254721A (en) |
Cited By (17)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN109633550A (en) * | 2018-12-28 | 2019-04-16 | 北汽福田汽车股份有限公司 | Vehicle and its object location determining method and device |
CN110095755A (en) * | 2019-04-01 | 2019-08-06 | 北京云知声信息技术有限公司 | A kind of sound localization method |
WO2020051836A1 (en) * | 2018-09-13 | 2020-03-19 | Alibaba Group Holding Limited | Methods and devices for processing audio input using unidirectional audio input devices |
CN111383650A (en) * | 2018-12-28 | 2020-07-07 | 深圳市优必选科技有限公司 | Robot and audio data processing method thereof |
CN111381211A (en) * | 2020-03-02 | 2020-07-07 | 北京声智科技有限公司 | Sound source positioning method and device |
CN111538352A (en) * | 2020-04-10 | 2020-08-14 | 南京信息职业技术学院 | Sound searching guide method |
CN112098934A (en) * | 2020-02-24 | 2020-12-18 | 苏州触达信息技术有限公司 | Intelligent device positioning method and intelligent device |
CN112161700A (en) * | 2020-09-18 | 2021-01-01 | 安徽江淮汽车集团股份有限公司 | Method and device for checking up lifting noise of car window glass |
CN112438660A (en) * | 2020-09-23 | 2021-03-05 | 深圳市修远文化创意有限公司 | Voice positioning method based on sweeping robot and related device |
CN112466325A (en) * | 2020-11-25 | 2021-03-09 | Oppo广东移动通信有限公司 | Sound source positioning method and apparatus, and computer storage medium |
CN112526452A (en) * | 2020-11-24 | 2021-03-19 | 杭州萤石软件有限公司 | Sound source detection method, pan-tilt camera, intelligent robot and storage medium |
CN112684413A (en) * | 2021-03-17 | 2021-04-20 | 杭州灵伴科技有限公司 | Sound source direction finding method and XR equipment |
CN112882536A (en) * | 2021-01-22 | 2021-06-01 | Oppo广东移动通信有限公司 | Control method, control device, electronic device, and storage medium |
CN112925235A (en) * | 2021-01-21 | 2021-06-08 | 深圳市普渡科技有限公司 | Sound source localization method, apparatus and computer-readable storage medium at the time of interaction |
CN113489841A (en) * | 2021-08-23 | 2021-10-08 | Oppo广东移动通信有限公司 | Sound quality processing method and device, electronic equipment and computer readable storage medium |
CN113766368A (en) * | 2021-08-20 | 2021-12-07 | 歌尔科技有限公司 | Control method of audio equipment and audio equipment |
CN114516061A (en) * | 2022-02-25 | 2022-05-20 | 杭州萤石软件有限公司 | Robot control method, robot system and robot |
Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN2585356Y (en) * | 2002-12-17 | 2003-11-05 | 王志良 | Electronic device for distinguishing direction of sound |
CN105807261A (en) * | 2016-04-26 | 2016-07-27 | 深思考人工智能机器人科技(北京)有限公司 | Device and method for distinguishing position by listening to sound |
CN106303810A (en) * | 2015-05-13 | 2017-01-04 | 青岛通产智能机器人有限公司 | Sound bearing based on directional sound sensor judgment means and method |
CN106501773A (en) * | 2016-12-23 | 2017-03-15 | 上海语知义信息技术有限公司 | Sounnd source direction localization method based on difference array |
CN107026934A (en) * | 2016-10-27 | 2017-08-08 | 华为技术有限公司 | A kind of sound localization method and device |
CN107685334A (en) * | 2017-09-27 | 2018-02-13 | 歌尔股份有限公司 | A kind of service robot charging method and service robot |
-
2018
- 2018-04-13 CN CN201810330841.7A patent/CN108254721A/en active Pending
Patent Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN2585356Y (en) * | 2002-12-17 | 2003-11-05 | 王志良 | Electronic device for distinguishing direction of sound |
CN106303810A (en) * | 2015-05-13 | 2017-01-04 | 青岛通产智能机器人有限公司 | Sound bearing based on directional sound sensor judgment means and method |
CN105807261A (en) * | 2016-04-26 | 2016-07-27 | 深思考人工智能机器人科技(北京)有限公司 | Device and method for distinguishing position by listening to sound |
CN107026934A (en) * | 2016-10-27 | 2017-08-08 | 华为技术有限公司 | A kind of sound localization method and device |
CN106501773A (en) * | 2016-12-23 | 2017-03-15 | 上海语知义信息技术有限公司 | Sounnd source direction localization method based on difference array |
CN107685334A (en) * | 2017-09-27 | 2018-02-13 | 歌尔股份有限公司 | A kind of service robot charging method and service robot |
Non-Patent Citations (1)
Title |
---|
祁兵兵 等: "基于8位单片机的玩具控制器的研究与实现", 《电声技术》 * |
Cited By (22)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2020051836A1 (en) * | 2018-09-13 | 2020-03-19 | Alibaba Group Holding Limited | Methods and devices for processing audio input using unidirectional audio input devices |
CN111383650B (en) * | 2018-12-28 | 2024-05-03 | 深圳市优必选科技有限公司 | Robot and audio data processing method thereof |
CN111383650A (en) * | 2018-12-28 | 2020-07-07 | 深圳市优必选科技有限公司 | Robot and audio data processing method thereof |
US10827258B2 (en) * | 2018-12-28 | 2020-11-03 | Ubtech Robotics Corp Ltd | Robot and audio data processing method thereof |
CN109633550A (en) * | 2018-12-28 | 2019-04-16 | 北汽福田汽车股份有限公司 | Vehicle and its object location determining method and device |
CN110095755A (en) * | 2019-04-01 | 2019-08-06 | 北京云知声信息技术有限公司 | A kind of sound localization method |
CN112098934A (en) * | 2020-02-24 | 2020-12-18 | 苏州触达信息技术有限公司 | Intelligent device positioning method and intelligent device |
CN111381211A (en) * | 2020-03-02 | 2020-07-07 | 北京声智科技有限公司 | Sound source positioning method and device |
CN111538352A (en) * | 2020-04-10 | 2020-08-14 | 南京信息职业技术学院 | Sound searching guide method |
CN112161700A (en) * | 2020-09-18 | 2021-01-01 | 安徽江淮汽车集团股份有限公司 | Method and device for checking up lifting noise of car window glass |
CN112438660A (en) * | 2020-09-23 | 2021-03-05 | 深圳市修远文化创意有限公司 | Voice positioning method based on sweeping robot and related device |
CN112526452A (en) * | 2020-11-24 | 2021-03-19 | 杭州萤石软件有限公司 | Sound source detection method, pan-tilt camera, intelligent robot and storage medium |
CN112466325A (en) * | 2020-11-25 | 2021-03-09 | Oppo广东移动通信有限公司 | Sound source positioning method and apparatus, and computer storage medium |
CN112466325B (en) * | 2020-11-25 | 2024-06-04 | Oppo广东移动通信有限公司 | Sound source positioning method and device and computer storage medium |
CN112925235A (en) * | 2021-01-21 | 2021-06-08 | 深圳市普渡科技有限公司 | Sound source localization method, apparatus and computer-readable storage medium at the time of interaction |
CN112882536A (en) * | 2021-01-22 | 2021-06-01 | Oppo广东移动通信有限公司 | Control method, control device, electronic device, and storage medium |
CN112684413A (en) * | 2021-03-17 | 2021-04-20 | 杭州灵伴科技有限公司 | Sound source direction finding method and XR equipment |
CN113766368A (en) * | 2021-08-20 | 2021-12-07 | 歌尔科技有限公司 | Control method of audio equipment and audio equipment |
CN113766368B (en) * | 2021-08-20 | 2022-10-18 | 歌尔科技有限公司 | Control method of audio equipment and audio equipment |
CN113489841A (en) * | 2021-08-23 | 2021-10-08 | Oppo广东移动通信有限公司 | Sound quality processing method and device, electronic equipment and computer readable storage medium |
CN114516061A (en) * | 2022-02-25 | 2022-05-20 | 杭州萤石软件有限公司 | Robot control method, robot system and robot |
CN114516061B (en) * | 2022-02-25 | 2024-03-05 | 杭州萤石软件有限公司 | Robot control method, robot system and robot |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN108254721A (en) | A kind of positioning sound source by robot and robot | |
CN110333503B (en) | Laser radar calibration method and device and electronic equipment | |
CN103247031B (en) | A kind of method of distorted image correction, terminal and system | |
CN103438798B (en) | Initiative binocular vision system overall calibration | |
CN107995478A (en) | Projecting method and projector equipment | |
CN103226386A (en) | Gesture identification method and system based on mobile terminal | |
US9591229B2 (en) | Image tracking control method, control device, and control equipment | |
CN105208648B (en) | For carrying out the method and apparatus and wireless location method and equipment of wireless location | |
CN106210511A (en) | A kind of method and apparatus positioning user | |
CN108537726A (en) | A kind of method of track up, equipment and unmanned plane | |
CN103702259A (en) | Interacting device and interacting method | |
CN110491316A (en) | A kind of projector and its method for controlling projection | |
CN112147994B (en) | Robot and recharging control method and device thereof | |
CN109840939A (en) | Three-dimensional rebuilding method, device, electronic equipment and storage medium | |
CN105306820A (en) | Method and device for controlling rotation of camera in mobile terminal and mobile terminal | |
CN110413011A (en) | A kind of binocular cloud platform control method, device and storage medium | |
CN105091878A (en) | Positioning method based on gait and positioning apparatus based on gait | |
CN105644320A (en) | Sun visor adjustment method and device | |
EP3360317A1 (en) | Autofocus method and apparatus using modulation transfer function curves | |
CN110570465B (en) | Real-time positioning and map construction method and device and computer readable storage medium | |
US9930462B2 (en) | System and method for on-site microphone calibration | |
CN107727115A (en) | Gyroscope bearing calibration and device | |
WO2021213249A1 (en) | Facial image acquisition and facial recognition | |
CN104378728B (en) | stereo audio processing method and device | |
US9733714B2 (en) | Computing system with command-sense mechanism and method of operation thereof |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
RJ01 | Rejection of invention patent application after publication |
Application publication date: 20180706 |
|
RJ01 | Rejection of invention patent application after publication |