CN108364648A - Method and device for obtaining audio-frequency information - Google Patents

Method and device for obtaining audio-frequency information Download PDF

Info

Publication number
CN108364648A
CN108364648A CN201810141926.0A CN201810141926A CN108364648A CN 108364648 A CN108364648 A CN 108364648A CN 201810141926 A CN201810141926 A CN 201810141926A CN 108364648 A CN108364648 A CN 108364648A
Authority
CN
China
Prior art keywords
audio
microphone
wake
signal
information
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201810141926.0A
Other languages
Chinese (zh)
Other versions
CN108364648B (en
Inventor
耿雷
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Baidu Netcom Science and Technology Co Ltd
Original Assignee
Beijing Baidu Netcom Science and Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Baidu Netcom Science and Technology Co Ltd filed Critical Beijing Baidu Netcom Science and Technology Co Ltd
Priority to CN201810141926.0A priority Critical patent/CN108364648B/en
Publication of CN108364648A publication Critical patent/CN108364648A/en
Application granted granted Critical
Publication of CN108364648B publication Critical patent/CN108364648B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00Speech recognition
    • G10L15/22Procedures used during a speech recognition process, e.g. man-machine dialogue

Landscapes

  • Engineering & Computer Science (AREA)
  • Computational Linguistics (AREA)
  • Health & Medical Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • Acoustics & Sound (AREA)
  • Multimedia (AREA)
  • Measurement Of Velocity Or Position Using Acoustic Or Ultrasonic Waves (AREA)
  • Circuit For Audible Band Transducer (AREA)

Abstract

The embodiment of the present application discloses the method and device for obtaining audio-frequency information.One specific implementation mode of this method includes:Pending audio is obtained in real time, and audio identification is carried out to pending audio;In response to detecting, there are wake-up signals in pending audio, obtain the first direction information of above-mentioned wake-up signal, and the audio-frequency information of the corresponding sound source of above-mentioned first direction information is obtained, above-mentioned first direction information is used to characterize the direction where the sound source for sending out above-mentioned wake-up signal;It is identical as the first direction information of above-mentioned wake-up signal in response to the second direction information of audio-frequency information, data processing is carried out to above-mentioned audio-frequency information, wherein above-mentioned second direction information is for characterizing the direction sent out where the sound source of audio-frequency information.This embodiment improves the efficiency for the audio-frequency information for obtaining sound source.

Description

Method and device for obtaining audio-frequency information
Technical field
The invention relates to field of computer technology, and in particular to audio signal processing technique field, more particularly, to Obtain the method and device of audio-frequency information.
Background technology
With the development of science and technology, smart machine provides a variety of facilities for the work and life of user.By smart machine, User can obtain newest news information, instant chat is carried out with other people, search professional data etc..
Under normal conditions, the operation needs of smart machine manually complete.In order to further increase the working efficiency of user, portion Divide smart machine that can support the interactive voice between user and smart machine.Support the smart machine of interactive voice that can obtain The audio-frequency information of user, and relevant instruction is got from audio-frequency information, realize corresponding operation.
Invention content
The purpose of the embodiment of the present application is to propose the method and device for obtaining audio-frequency information.
In a first aspect, the embodiment of the present application provides a kind of method for obtaining audio-frequency information, this method includes:In real time Pending audio is obtained, and audio identification is carried out to pending audio;Letter is waken up in response to detecting to exist in pending audio Number, the first direction information of above-mentioned wake-up signal is obtained, and obtain the audio-frequency information of the corresponding sound source of above-mentioned first direction information, Above-mentioned first direction information is used to characterize the direction where the sound source for sending out above-mentioned wake-up signal;In response to the second of audio-frequency information Directional information is identical as the first direction information of above-mentioned wake-up signal, carries out data processing to above-mentioned audio-frequency information, wherein above-mentioned Second direction information is for characterizing the direction sent out where the sound source of audio-frequency information.
In some embodiments, the above method further includes:Select a microphone as calling out from above-mentioned microphone array Awake signal monitoring microphone, above-mentioned wake-up signal monitoring microphone is for acquiring pending audio.
In some embodiments, the first direction information of the above-mentioned wake-up signal of above-mentioned acquisition includes:Obtain microphone array In each microphone acquisition pending audio, determine label time of the above-mentioned wake-up signal in each pending audio, obtain To label time set;The label time in label time set is ranked up according to chronological order, when obtaining label Between sequence;It is directed toward according to the space of corresponding microphone of preceding setting label time in above-mentioned label time series and sets above-mentioned call out The direction that audio is acquired for characterizing microphone is directed toward in the first direction information of awake signal, above-mentioned space.
In some embodiments, above-mentioned according to corresponding microphone of preceding setting label time in above-mentioned label time series Space be directed toward and set the first direction information of above-mentioned wake-up signal and include:Microphone spatial Compass is inquired, each wheat is obtained Corresponding space angle is directed toward in the space of gram wind, and the space that above-mentioned microphone spatial Compass is used to characterize microphone is directed toward and wheat Correspondence where gram wind at spatial position between the space angle of acquisition audio;By setting before in above-mentioned label time series The angular range that corresponding space angle is constituted is directed toward in the space of fixed label time corresponding microphone, and according to above-mentioned angle Range is set as the first direction information of above-mentioned wake-up signal.
In some embodiments, the above method further includes:Second direction information in response to audio-frequency information and above-mentioned wake-up The first direction information of signal differs, then, there are when wake-up signal, is reacquiring wake-up signal in detecting audio-frequency information First direction information.
Second aspect, the embodiment of the present application provide a kind of device for obtaining audio-frequency information, which includes:Audio Recognition unit carries out audio identification for obtaining pending audio in real time, and to pending audio;First direction acquisition of information list Member, in response to detecting there are wake-up signal in pending audio, the first direction information for obtaining above-mentioned wake-up signal, and The audio-frequency information of the corresponding sound source of above-mentioned first direction information is obtained, above-mentioned first direction information sends out above-mentioned wake-up for characterizing Direction where the sound source of signal;Audio-frequency information collecting unit, in response to second direction information and the above-mentioned wake-up of audio-frequency information The first direction information of signal is identical, for carrying out data processing to above-mentioned audio-frequency information, wherein above-mentioned second direction information is used Direction where characterization sends out the sound source of audio-frequency information.
In some embodiments, above-mentioned apparatus further includes:Microphone setting unit, for being selected from above-mentioned microphone array It selects a microphone and monitors microphone as wake-up signal, above-mentioned wake-up signal monitoring microphone is for acquiring pending audio.
In some embodiments, above-mentioned first direction information acquisition unit includes:Pending audio obtains subelement, is used for The pending audio for obtaining each microphone acquisition in above-mentioned microphone array, determines above-mentioned wake-up signal in each pending sound The label time in frequency obtains label time set;Time series is marked to obtain subelement, for according to chronological order pair The label time in label time set is ranked up, and obtains label time series;Subelement is arranged in first direction information, is used for It is directed toward according to the space of corresponding microphone of preceding setting label time in above-mentioned label time series and sets above-mentioned wake-up signal First direction information, the direction that audio is acquired for characterizing microphone is directed toward in above-mentioned space.
In some embodiments, above-mentioned first direction information setting subelement includes:Space angle enquiry module, for looking into Microphone spatial Compass is ask, corresponding space angle is directed toward in the space for obtaining each microphone, and above-mentioned microphone spatial is directed toward Table is used to characterize corresponding between the space direction of microphone and the space angle of acquisition audio at spatial position where microphone Relationship;First direction information setting module, for passing through corresponding wheat of preceding setting label time in above-mentioned label time series The angular range that corresponding space angle is constituted is directed toward in the space of gram wind, and is set as above-mentioned wake-up according to above-mentioned angular range and is believed Number first direction information.
In some embodiments, above-mentioned apparatus further includes:First direction information updating unit, in response to the of audio-frequency information Two directional informations and the first direction information of above-mentioned wake-up signal differ, and letter is waken up for existing in detecting audio-frequency information Number when, reacquire the first direction information of wake-up signal.
The third aspect, the embodiment of the present application provide a kind of server, including:One or more processors;Memory is used In the one or more programs of storage;Microphone array, the audio-frequency information for acquiring sound source;When said one or multiple program quilts When said one or multiple processors execute so that said one or multiple processors execute above-mentioned first aspect for obtaining The method of audio-frequency information.
Fourth aspect, the embodiment of the present application provide a kind of computer readable storage medium, are stored thereon with computer journey Sequence, which is characterized in that the program realizes the method for obtaining audio-frequency information of above-mentioned first aspect when being executed by processor.
Method and device provided by the embodiments of the present application for obtaining audio-frequency information is detected from pending audio and is called out It wakes up after signal, obtains the first direction information of wake-up signal;Later in the second direction information of audio-frequency information and wake-up signal Data processing is carried out to audio-frequency information when first direction information is identical.The present embodiment method is as long as detecting a wake-up signal The audio-frequency information that continuous collecting sound source may be implemented avoids the frequent detection to wake-up signal, and wakes up letter detecting To the frequent detection of first direction information after number, the efficiency for the audio-frequency information for obtaining sound source is improved.
Description of the drawings
By reading a detailed description of non-restrictive embodiments in the light of the attached drawings below, the application's is other Feature, objects and advantages will become more apparent upon:
Fig. 1 is that this application can be applied to exemplary system architecture figures therein;
Fig. 2 is the flow chart according to one embodiment of the method for obtaining audio-frequency information of the application;
Fig. 3 is the schematic diagram according to an application scenarios of the method for obtaining audio-frequency information of the application;
Fig. 4 is the structural schematic diagram according to one embodiment of the device for obtaining audio-frequency information of the application;
Fig. 5 is adapted for the system structure diagram of the server for realizing the embodiment of the present application.
Specific implementation mode
The application is described in further detail with reference to the accompanying drawings and examples.It is understood that this place is retouched The specific embodiment stated is used only for explaining related invention, rather than the restriction to the invention.It also should be noted that in order to Convenient for description, is illustrated only in attached drawing and invent relevant part with related.
It should be noted that in the absence of conflict, the features in the embodiments and the embodiments of the present application can phase Mutually combination.The application is described in detail below with reference to the accompanying drawings and in conjunction with the embodiments.
Fig. 1 shows the method for obtaining audio-frequency information that can apply the application or the dress for obtaining audio-frequency information The exemplary system architecture 100 for the embodiment set.
As shown in Figure 1, system architecture 100 may include audio collecting device 101, network 102 and server 103.Network 102 between audio collecting device 101 and server 103 provide communication link medium.Wherein, server 103 is used for Data processing is carried out to the data that audio collecting device 101 acquires.Network 102 may include various connection types, such as wired, Wireless communication link or fiber optic cables etc..
Audio collecting device 101 can acquire audio-frequency information;What server 103 was used to acquire in audio collecting device 101 There are when wake-up signal in pending audio, audio-frequency information is acquired, and in the side of the directional information of audio-frequency information and wake-up signal When identical to information, data processing is carried out to audio-frequency information.
Audio collecting device 101 can be independent microphone array, integrated microphone array etc. on an electronic device; Server 103 can be to provide the server of various services, such as be carried out at data to the data that audio collecting device 101 acquires The server of reason.Server 103 carries out data processing to the data that audio collecting device 101 acquires so that audio collecting device 101 can accurately obtain the audio-frequency information of sound source.
It should be noted that the method for obtaining audio-frequency information that the embodiment of the present application is provided is generally by server 103 execute, and correspondingly, the device for obtaining audio-frequency information is generally positioned in server 103.
It should be understood that the number of the audio collecting device, network and server in Fig. 1 is only schematical.According to reality It now needs, can have any number of audio collecting device, network and server.
With continued reference to Fig. 2, the stream of one embodiment of the method for obtaining audio-frequency information according to the application is shown Journey 200.The method for being used to obtain audio-frequency information includes the following steps:
Step 201, pending audio is obtained in real time, and audio identification is carried out to pending audio.
In the present embodiment, it is (such as shown in FIG. 1 to run electronic equipment thereon for the method for obtaining audio-frequency information Server 103) can by wired connection mode or radio connection from audio collecting device 101 (such as can be wheat Gram wind array) receive pending audio.It should be pointed out that above-mentioned radio connection can include but is not limited to 3G/4G companies Connect, WiFi connections, bluetooth connection, WiMAX connections, Zigbee connections, UWB (ultra wideband) connections and other are existing In known or exploitation in the future radio connection.
When user's (i.e. sound source) is within the scope of distance microphone array certain distance, microphone array can collect use The pending audio at family.Under normal conditions, the pending audio of user can include wake-up signal and/or for carrying out data The instruction of processing.It when the existing audio-frequency information by user carries out relevant data manipulation, needs first to receive wake-up signal, accuse Primary data processing equipment receives data processing instructions, then obtains data processing instructions from audio again, and carry out relevant number According to operation.As it can be seen that the frequency that wake-up signal occurs in data processing is too high, and user may be in the case of movement The audio-frequency information sent out, in order to obtain clear effective audio-frequency information, microphone array every time will be again to the position of user It is positioned, and then determines the direction of acquisition audio-frequency information;Then it identifies again and whether there is wake-up signal in audio user information, Obtain the inefficient of the audio-frequency information of sound source.
In the application, server 103 can obtain the pending audio of microphone array acquisition in real time, and to pending sound Frequency carries out audio identification.
In some optional realization methods of the present embodiment, the above method can also include:From above-mentioned microphone array It is middle that a microphone is selected to monitor microphone as wake-up signal.
In order to obtain clear accurate audio-frequency information as possible, microphone array generally comprises multiple microphones, multiple Mikes Wind can be combined into the isostructural microphone array of spherical spheres shape.And for a certain sound source, each microphone collects Time of audio signal of sound source can be different, it is former in distance and angle etc. relative to sound source that this is primarily due to each microphone Caused by.In order to reduce data processing amount and avoid interfering with each other between signal, the present embodiment can be from microphone array It is middle that a microphone is selected to monitor microphone as wake-up signal, other Mikes in microphone array in addition to monitoring microphone Wind also acquires pending audio, but is not used in detection and wakes up word.Wherein, wake-up signal monitoring microphone is for acquiring pending sound Frequently.Monitoring microphone can select (to acquire the angle of audio-frequency information closest to the microphone of sound source or the angle of space-oriented Degree) maximum microphone.
Step 202, in response to detecting, there are wake-up signals in pending audio, obtain the first party of above-mentioned wake-up signal To information, and obtain the audio-frequency information of the corresponding sound source of above-mentioned first direction information.
When server 105 detects in pending audio there are when wake-up signal, it can control what microphone array included Whole microphones acquire audio-frequency information.By the difference for the audio-frequency information that each microphone is acquired can determine sound source relative to The first direction information of microphone array.Wherein, above-mentioned first direction information is for characterizing the sound source for sending out above-mentioned wake-up signal The direction at place.And then the corresponding sound source of first direction information is obtained (i.e. pointed by the corresponding direction of first direction information Sound source) audio-frequency information.Since audio-frequency information at this time obtains after getting wake-up signal, the audio-frequency information Relevant operational order is generally comprised.
In some optional realization methods of the present embodiment, the first direction information of the above-mentioned above-mentioned wake-up signal of acquisition can To include the following steps:
The first step obtains the pending audio of each microphone acquisition in microphone array, determines that above-mentioned wake-up signal exists The label time in each pending audio obtains label time set.
When microphone array acquires the audio of sound source, each microphone can collect waiting for for sound source in microphone array Handle audio.The audio-frequency information of each microphone acquisition can be on the basis of the time on server 103 on microphone array. Since the mutual alignment between microphone is different, the angle of the pending audio of acquisition between microphone is also different, this is resulted in The time that the audio that same sound source is sent out reaches each microphone is different, i.e., includes in the audio-frequency information of each microphone acquisition The wake-up signal corresponding label time is different.For this purpose, correspondence can be extracted from the pending audio that each microphone acquires The label time of wake-up signal.In this way, the label time set of corresponding microphone array can be obtained.
Second step is ranked up the label time in label time set according to chronological order, when obtaining label Between sequence.
Seen from the above description, the position and angle of microphone different in microphone array and sound source are all different from each other. Under normal conditions, the audio that sound source is sent out reaches each microphone with constant speed.Therefore, just by the above-mentioned label time It may determine which microphone is closer at a distance from sound source.It, can be to the label time in label time set in the present embodiment The sequencing occurred according to the label time is ranked up, and obtains label time series.
Third walks, and is directed toward and is set according to the space of corresponding microphone of preceding setting label time in above-mentioned label time series The first direction information of fixed above-mentioned wake-up signal.
It marks the time more early, illustrates that corresponding microphone is closer from sound source;It marks the time more late, illustrates corresponding microphone It is remoter from sound source.In conjunction with the position relationship between microphone, can be directed toward by the space of microphone to set wake-up signal First direction information (for characterizing direction of the sound source relative to microphone array).Wherein, above-mentioned space is directed toward for characterizing wheat The direction of gram elegance collection audio.The direction of microphone acquisition audio may be considered side when microphone obtains clear audio signal To.In practice, space is directed toward and could be provided as some direction in space or some direction scope.
It is above-mentioned according to preceding setting mark in above-mentioned label time series in some optional realization methods of the present embodiment The first direction information of the above-mentioned wake-up signal of space direction setting of corresponding microphone may comprise steps of between clocking:
The first step inquires microphone spatial Compass, and corresponding space angle is directed toward in the space for obtaining each microphone.
When being arranged microphone array in some position, for the ease of determining the position of sound source, wheat can be built first Gram wind space Compass.Wherein, above-mentioned microphone spatial Compass is used to characterize space direction and the microphone place of microphone The correspondence between the space angle of audio is acquired at spatial position.By inquiring microphone spatial Compass, can obtain It is directed toward corresponding space angle in the space of each microphone.
Second step passes through the space direction pair of corresponding microphone of preceding setting label time in above-mentioned label time series The angular range that the space angle answered is constituted, and the first direction for being set as according to above-mentioned angular range above-mentioned wake-up signal is believed Breath.
Preceding setting in label time series can be obtained by above-mentioned microphone spatial Compass to mark in the time often It is directed toward corresponding space angle in a space for marking time corresponding microphone;Later, these space angles are combined It can obtain an angular range.It, can be by the angle where the corresponding angular bisector of the angular range after obtaining angular range It is determined as the first direction information of wake-up signal.The first direction information can be determined specific by installation space coordinate system Angular configurations.
It is step 203, identical as the first direction information of above-mentioned wake-up signal in response to the second direction information of audio-frequency information, Data processing is carried out to above-mentioned audio-frequency information.
Seen from the above description, microphone array is listed in after server 103 determines wake-up signal, can acquire wake-up letter The audio-frequency information of number corresponding sound source.Sound source can be static, can also be mobile.For when sound source is static, After one-time detection to wake-up signal, as long as the second direction information of the audio-frequency information of subsequent acquisition and the first direction of wake-up signal Information is identical, so that it may to illustrate that the position of sound source does not change, without being carried out to the audio-frequency information of acquisition every time Wake-up signal detects.Later, microphone array can be controlled according to the first direction information of wake-up signal, is called out with obtaining The audio-frequency information of the corresponding sound source of first direction information of awake signal, and then corresponding data processing is carried out to audio-frequency information.Such as This, can improve to avoid frequent detection wake-up signal and the frequent first direction information for obtaining wake-up signal and obtain audio letter The efficiency of breath.Wherein, above-mentioned second direction information is for characterizing the direction sent out where the sound source of audio-frequency information.
In some optional realization methods of the present embodiment, the above method can also include:In response to audio-frequency information Second direction information and the first direction information of above-mentioned wake-up signal differ, then exist in detecting audio-frequency information and wake up letter Number when, reacquire the first direction information of wake-up signal.
Seen from the above description, sound source can be static, can also be mobile.When sound source moves, microphone array The second direction information for arranging the audio-frequency information of acquisition is different from the first direction information of wake-up signal.In order to obtain accurately and effectively Audio-frequency information needs to detect wake-up signal again, and reacquires the first direction information of wake-up signal, controls Mike again later The audio-frequency information of the wind array acquisition corresponding sound source of first direction information of wake-up signal at this time, so as to realize to sound source with Track.
In the above process, after getting the first direction information of wake-up signal, control microphone array acquisition audio Step may include:
The first step determines above-mentioned sound source corresponding sound source angle in microphone spatial Compass.
It is adopted at spatial position where space direction and microphone of the above-mentioned microphone spatial Compass for characterizing microphone Collect the correspondence between the space angle of audio.By inquiring microphone spatial Compass, each microphone can be obtained It is directed toward corresponding space angle in space.
The corresponding microphone of above-mentioned sound source angle is set as sound source microphone, and passes through above-mentioned sound source Mike by second step Elegance collection audio-frequency information.
The corresponding microphone of sound source angle can be set as sound source microphone by server 103, and sound source microphone can be recognized For the microphone for being on the direction of distance and acquisition audio closest to sound source.Later, server 103 can pass through above-mentioned sound Source microphone acquires audio-frequency information.It should be noted that sound source microphone can be one, can also be multiple.
It is above-mentioned to be adopted according to above-mentioned location information control microphone array in some optional realization methods of the present embodiment Collecting the audio-frequency information of above-mentioned sound source can also include:Shield the microphone acquisition other than sound source microphone in above-mentioned microphone array Audio-frequency information.
In order to track dynamic sound source, shape of each microphone that microphone array includes all in acquisition audio State.After sound source microphone is determined, in order to avoid the interference of the audio-frequency information of other microphones acquisition, microphone can be shielded The audio-frequency information of microphone acquisition in array other than sound source microphone, to improve the accuracy to audio information analysis.
When not collecting the audio-frequency information of above-mentioned sound source in setting time, it is believed that sound source does not retransmit audio Information.At this moment, server 105 can control the audio-frequency information that microphone array stops acquiring above-mentioned sound source.
It is one of the application scenarios of the method according to the present embodiment for obtaining audio-frequency information with continued reference to Fig. 3, Fig. 3 Schematic diagram.In the application scenarios of Fig. 3, user's (sound source) can send out wake-up signal, Mike classroom (or other spaces) are inner After wind array 101 collects wake-up signal, server 103 identifies wake-up signal, and obtains the first direction letter of wake-up signal Breath;Later, the control of server 104 control microphone array 101 acquires the audio-frequency information of user and carries out data to audio-frequency information Processing, and then control the content of screen display.
The method that above-described embodiment of the application provides obtains waking up letter after detecting wake-up signal in pending audio Number first direction information;Later when the second direction information of audio-frequency information is identical as the first direction information of wake-up signal pair Audio-frequency information carries out data processing.As long as the present embodiment method detects that a wake-up signal realizes continuous collecting sound source Audio-frequency information, avoid the frequent detection to wake-up signal, and to first direction information after detecting wake-up signal Frequently detection improves the efficiency for the audio-frequency information for obtaining sound source.
With further reference to Fig. 4, as the realization to method shown in above-mentioned each figure, this application provides one kind for obtaining sound One embodiment of the device of frequency information, the device embodiment is corresponding with embodiment of the method shown in Fig. 2, which specifically may be used To be applied in various electronic equipments.
As shown in figure 4, the device 400 for obtaining audio-frequency information of the present embodiment may include:Audio identification unit 401, first direction information acquisition unit 402 and audio-frequency information collecting unit 403.Wherein, audio identification unit 401 is for real-time Pending audio is obtained, and audio identification is carried out to pending audio;First direction information acquisition unit 402, in response to detection To in pending audio there are wake-up signal, the first direction information for obtaining above-mentioned wake-up signal, and obtain above-mentioned first The audio-frequency information of the corresponding sound source of directional information, above-mentioned first direction information is for characterizing the sound source institute for sending out above-mentioned wake-up signal Direction;Audio-frequency information collecting unit 403, in response to the second direction information and the first of above-mentioned wake-up signal of audio-frequency information Directional information is identical, for carrying out data processing to above-mentioned audio-frequency information, wherein above-mentioned second direction information is sent out for characterizing Direction where the sound source of audio-frequency information.
In some optional realization methods of the present embodiment, the device 400 for obtaining audio-frequency information can also include: Microphone setting unit (not shown), for selecting a microphone to be supervised as wake-up signal from above-mentioned microphone array Microphone is surveyed, above-mentioned wake-up signal monitoring microphone is for acquiring pending audio.
In some optional realization methods of the present embodiment, above-mentioned first direction information acquisition unit 402 may include: Pending audio obtains subelement (not shown), label time series obtains subelement (not shown) and first direction Subelement (not shown) is arranged in information.Wherein, pending audio obtains subelement for obtaining in above-mentioned microphone array The pending audio of each microphone acquisition, determines label time of the above-mentioned wake-up signal in each pending audio, obtains Mark time set;It marks time series to obtain subelement to be used for according to chronological order to the label in label time set Time is ranked up, and obtains label time series;First direction information is arranged subelement and is used for according to above-mentioned label time series In the space of corresponding microphone of preceding setting label time be directed toward the first direction information for setting above-mentioned wake-up signal, above-mentioned sky Between be directed toward for characterize microphone acquire audio direction.
In some optional realization methods of the present embodiment, above-mentioned first direction information setting subelement may include: Space angle enquiry module (not shown) and first direction information setting module (not shown).Wherein, space angle For enquiry module for inquiring microphone spatial Compass, corresponding space angle is directed toward in the space for obtaining each microphone, above-mentioned Microphone spatial Compass is used to characterize the space of the space direction and acquisition audio at spatial position where microphone of microphone Correspondence between angle;First direction information setting module is used for through preceding setting label in above-mentioned label time series The angular range that corresponding space angle is constituted is directed toward in the space of time corresponding microphone, and is set according to above-mentioned angular range For the first direction information of above-mentioned wake-up signal.
In some optional realization methods of the present embodiment, the device 400 for obtaining audio-frequency information can also include: First direction information updating unit, in response to the first direction information of the second direction information and above-mentioned wake-up signal of audio-frequency information It differs, for there are the first direction information for when wake-up signal, reacquiring wake-up signal in detecting audio-frequency information.
The present embodiment additionally provides a kind of server, including:One or more processors;Memory, for storing one Or multiple programs, microphone array, the audio-frequency information for acquiring sound source;When said one or multiple programs by said one or When multiple processors execute so that said one or multiple processors execute the above-mentioned method for obtaining audio-frequency information.
The present embodiment additionally provides a kind of computer readable storage medium, is stored thereon with computer program, the program quilt Processor realizes the above-mentioned method for obtaining audio-frequency information when executing.
Below with reference to Fig. 5, it illustrates the computer systems 500 suitable for the server for realizing the embodiment of the present application Structural schematic diagram.Server shown in Fig. 5 is only an example, should not be to the function and use scope band of the embodiment of the present application Carry out any restrictions.
As shown in figure 5, computer system 500 includes central processing unit (CPU) 501, it can be read-only according to being stored in Program in memory (ROM) 502 or be loaded into the program in random access storage device (RAM) 503 from storage section 508 and Execute various actions appropriate and processing.In RAM 503, also it is stored with system 500 and operates required various programs and data. CPU 501, ROM 502 and RAM 503 are connected with each other by bus 504.Input/output (I/O) interface 505 is also connected to always Line 504.
It is connected to I/O interfaces 505 with lower component:Importation 506 including keyboard, mouse etc.;It is penetrated including such as cathode The output par, c 507 of spool (CRT), liquid crystal display (LCD) etc. and loud speaker etc.;Storage section 508 including hard disk etc.; And the communications portion 509 of the network interface card including LAN card, modem etc..Communications portion 509 via such as because The network of spy's net executes communication process.Driver 510 is also according to needing to be connected to I/O interfaces 505.Detachable media 511, such as Disk, CD, magneto-optic disk, semiconductor memory etc. are mounted on driver 510, as needed in order to be read from thereon Computer program be mounted into storage section 508 as needed.
Particularly, in accordance with an embodiment of the present disclosure, it may be implemented as computer above with reference to the process of flow chart description Software program.For example, embodiment of the disclosure includes a kind of computer program product comprising be carried on computer-readable medium On computer program, which includes the program code for method shown in execution flow chart.In such reality It applies in example, which can be downloaded and installed by communications portion 509 from network, and/or from detachable media 511 are mounted.When the computer program is executed by central processing unit (CPU) 501, limited in execution the present processes Above-mentioned function.
It should be noted that the above-mentioned computer-readable medium of the application can be computer-readable signal media or meter Calculation machine readable storage medium storing program for executing either the two arbitrarily combines.Computer readable storage medium for example can be --- but not Be limited to --- electricity, magnetic, optical, electromagnetic, infrared ray or semiconductor system, device or device, or arbitrary above combination.Meter The more specific example of calculation machine readable storage medium storing program for executing can include but is not limited to:Electrical connection with one or more conducting wires, just It takes formula computer disk, hard disk, random access storage device (RAM), read-only memory (ROM), erasable type and may be programmed read-only storage Device (EPROM or flash memory), optical fiber, portable compact disc read-only memory (CD-ROM), light storage device, magnetic memory device, Or above-mentioned any appropriate combination.In this application, can be any include computer readable storage medium or storage journey The tangible medium of sequence, the program can be commanded the either device use or in connection of execution system, device.And at this In application, computer-readable signal media may include in a base band or as the data-signal that a carrier wave part is propagated, Wherein carry computer-readable program code.Diversified forms may be used in the data-signal of this propagation, including but unlimited In electromagnetic signal, optical signal or above-mentioned any appropriate combination.Computer-readable signal media can also be that computer can Any computer-readable medium other than storage medium is read, which can send, propagates or transmit and be used for By instruction execution system, device either device use or program in connection.Include on computer-readable medium Program code can transmit with any suitable medium, including but not limited to:Wirelessly, electric wire, optical cable, RF etc. or above-mentioned Any appropriate combination.
Flow chart in attached drawing and block diagram, it is illustrated that according to the system of the various embodiments of the application, method and computer journey The architecture, function and operation in the cards of sequence product.In this regard, each box in flowchart or block diagram can generation A part for a part for one module, program segment, or code of table, the module, program segment, or code includes one or more uses The executable instruction of the logic function as defined in realization.It should also be noted that in some implementations as replacements, being marked in box The function of note can also occur in a different order than that indicated in the drawings.For example, two boxes succeedingly indicated are actually It can be basically executed in parallel, they can also be executed in the opposite order sometimes, this is depended on the functions involved.Also it to note Meaning, the combination of each box in block diagram and or flow chart and the box in block diagram and or flow chart can be with holding The dedicated hardware based system of functions or operations as defined in row is realized, or can use specialized hardware and computer instruction Combination realize.
Being described in unit involved in the embodiment of the present application can be realized by way of software, can also be by hard The mode of part is realized.Described unit can also be arranged in the processor, for example, can be described as:A kind of processor packet Include audio identification unit, first direction information acquisition unit and audio-frequency information collecting unit.Wherein, the title of these units is at certain The restriction to the unit itself is not constituted in the case of kind, for example, audio-frequency information collecting unit is also described as " for adopting Collect the unit of the audio-frequency information of sound source ".
As on the other hand, present invention also provides a kind of computer-readable medium, which can be Included in device described in above-described embodiment;Can also be individualism, and without be incorporated the device in.Above-mentioned calculating Machine readable medium carries one or more program, when said one or multiple programs are executed by the device so that should Device:Pending audio is obtained in real time, and audio identification is carried out to pending audio;It is deposited in response to detecting in pending audio In wake-up signal, the first direction information of above-mentioned wake-up signal is obtained, and obtains the corresponding sound source of above-mentioned first direction information Audio-frequency information, above-mentioned first direction information are used to characterize the direction where the sound source for sending out above-mentioned wake-up signal;In response to audio The second direction information of information is identical as the first direction information of above-mentioned wake-up signal, is carried out at data to above-mentioned audio-frequency information Reason, wherein above-mentioned second direction information is for characterizing the direction sent out where the sound source of audio-frequency information.
Above description is only the preferred embodiment of the application and the explanation to institute's application technology principle.People in the art Member should be appreciated that invention scope involved in the application, however it is not limited to technology made of the specific combination of above-mentioned technical characteristic Scheme, while should also cover in the case where not departing from foregoing invention design, it is carried out by above-mentioned technical characteristic or its equivalent feature Other technical solutions of arbitrary combination and formation.Such as features described above has similar work(with (but not limited to) disclosed herein Can technical characteristic replaced mutually and the technical solution that is formed.

Claims (12)

1. a kind of method for obtaining audio-frequency information, which is characterized in that the method includes:
Pending audio is obtained in real time, and audio identification is carried out to pending audio;
In response to detecting, there are wake-up signals in pending audio, obtain the first direction information of the wake-up signal, and obtain The audio-frequency information of the corresponding sound source of the first direction information, the first direction information is taken to send out the wake-up letter for characterizing Number sound source where direction;
It is identical as the first direction information of the wake-up signal in response to the second direction information of audio-frequency information, the audio is believed Breath carries out data processing, wherein the second direction information is for characterizing the direction sent out where the sound source of audio-frequency information.
2. according to the method described in claim 1, it is characterized in that, the method further includes:
A microphone is selected to monitor microphone as wake-up signal from the microphone array, the wake-up signal monitors wheat Gram wind is for acquiring pending audio.
3. according to the method described in claim 1, it is characterized in that, the first direction packet for obtaining the wake-up signal It includes:
The pending audio for obtaining each microphone acquisition in microphone array, determines the wake-up signal in each pending sound The label time in frequency obtains label time set;
The label time in label time set is ranked up according to chronological order, obtains label time series;
It is directed toward according to the space of corresponding microphone of preceding setting label time in the label time series and sets the wake-up The direction that audio is acquired for characterizing microphone is directed toward in the first direction information of signal, the space.
4. according to the method described in claim 3, it is characterized in that, described according to preceding setting mark in the label time series The first direction information of the space direction setting wake-up signal of corresponding microphone includes between clocking:
Microphone spatial Compass is inquired, corresponding space angle is directed toward in the space for obtaining each microphone, and the microphone is empty Between Compass be used to characterize microphone space be directed toward and microphone where at spatial position between the space angle of acquisition audio Correspondence;
It is directed toward corresponding Space Angle by the space of corresponding microphone of preceding setting label time in the label time series The angular range constituted is spent, and is set as the first direction information of the wake-up signal according to the angular range.
5. according to the method described in claim 1, it is characterized in that, the method further includes:
It differs, is then detecting in response to the second direction information of audio-frequency information and the first direction information of the wake-up signal There are the first direction information for when wake-up signal, reacquiring wake-up signal in audio-frequency information.
6. a kind of for obtaining the device of audio-frequency information, which is characterized in that described device includes:
Audio identification unit carries out audio identification for obtaining pending audio in real time, and to pending audio;
First direction information acquisition unit, in response to detecting, there are wake-up signals in pending audio, for obtaining described call out The first direction information of awake signal, and obtain the audio-frequency information of the corresponding sound source of the first direction information, the first direction Information is used to characterize the direction where the sound source for sending out the wake-up signal;
Audio-frequency information collecting unit, in response to the first direction information of the second direction information and the wake-up signal of audio-frequency information It is identical, for carrying out data processing to the audio-frequency information, wherein the second direction information sends out audio-frequency information for characterizing Sound source where direction.
7. device according to claim 6, which is characterized in that described device further includes:
Microphone setting unit, for selecting a microphone to monitor Mike as wake-up signal from the microphone array Wind, the wake-up signal monitoring microphone is for acquiring pending audio.
8. device according to claim 6, which is characterized in that the first direction information acquisition unit includes:
Pending audio obtains subelement, the pending audio for obtaining each microphone acquisition in the microphone array, It determines label time of the wake-up signal in each pending audio, obtains label time set;
Time series is marked to obtain subelement, for being carried out to the label time in label time set according to chronological order Sequence obtains label time series;
Subelement is arranged in first direction information, for according to corresponding wheat of preceding setting label time in the label time series The first direction information for setting the wake-up signal is directed toward in the space of gram wind, and the space is directed toward acquires sound for characterizing microphone The direction of frequency.
9. device according to claim 8, which is characterized in that the first direction information is arranged subelement and includes:
Space angle enquiry module, for inquiring microphone spatial Compass, the space direction for obtaining each microphone is corresponding Space angle is adopted where space direction and microphone of the microphone spatial Compass for characterizing microphone at spatial position Collect the correspondence between the space angle of audio;
First direction information setting module, for passing through corresponding Mike of preceding setting label time in the label time series The angular range that corresponding space angle is constituted is directed toward in the space of wind, and is set as the wake-up signal according to the angular range First direction information.
10. device according to claim 6, which is characterized in that described device further includes:
First direction information updating unit, in response to the first direction of the second direction information and the wake-up signal of audio-frequency information Information differs, in detecting audio-frequency information there are when wake-up signal, reacquire wake-up signal first direction letter Breath.
11. a kind of server, including:
One or more processors;
Memory, for storing one or more programs;
Microphone array, the audio-frequency information for acquiring sound source;
When one or more of programs are executed by one or more of processors so that one or more of processors Perform claim requires any method in 1 to 5.
12. a kind of computer readable storage medium, is stored thereon with computer program, which is characterized in that the program is by processor The method as described in any in claim 1 to 5 is realized when execution.
CN201810141926.0A 2018-02-11 2018-02-11 Method and device for acquiring audio information Active CN108364648B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201810141926.0A CN108364648B (en) 2018-02-11 2018-02-11 Method and device for acquiring audio information

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201810141926.0A CN108364648B (en) 2018-02-11 2018-02-11 Method and device for acquiring audio information

Publications (2)

Publication Number Publication Date
CN108364648A true CN108364648A (en) 2018-08-03
CN108364648B CN108364648B (en) 2021-08-03

Family

ID=63005834

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201810141926.0A Active CN108364648B (en) 2018-02-11 2018-02-11 Method and device for acquiring audio information

Country Status (1)

Country Link
CN (1) CN108364648B (en)

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109286875A (en) * 2018-09-29 2019-01-29 百度在线网络技术(北京)有限公司 For orienting method, apparatus, electronic equipment and the storage medium of pickup
CN109473111A (en) * 2018-12-29 2019-03-15 苏州思必驰信息科技有限公司 A kind of voice enabling apparatus and method
CN110910878A (en) * 2019-11-27 2020-03-24 珠海格力电器股份有限公司 Voice wake-up control method and device, storage medium and household appliance
CN111505583A (en) * 2020-05-07 2020-08-07 北京百度网讯科技有限公司 Sound source positioning method, device, equipment and readable storage medium
CN113519022A (en) * 2019-02-27 2021-10-19 三星电子株式会社 Electronic device and control method thereof

Citations (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103440313A (en) * 2013-08-27 2013-12-11 复旦大学 Music retrieval system based on audio fingerprint features
CN105045122A (en) * 2015-06-24 2015-11-11 张子兴 Intelligent household natural interaction system based on audios and videos
CN105556592A (en) * 2013-06-27 2016-05-04 亚马逊技术股份有限公司 Detecting self-generated wake expressions
CN106098075A (en) * 2016-08-08 2016-11-09 腾讯科技(深圳)有限公司 Audio collection method and apparatus based on microphone array
CN106653041A (en) * 2017-01-17 2017-05-10 北京地平线信息技术有限公司 Audio signal processing equipment and method as well as electronic equipment
CN106898360A (en) * 2017-04-06 2017-06-27 北京地平线信息技术有限公司 Acoustic signal processing method, device and electronic equipment
CN107132508A (en) * 2017-04-26 2017-09-05 杭州仁盈科技股份有限公司 Sound localization method and device
CN107146614A (en) * 2017-04-10 2017-09-08 北京猎户星空科技有限公司 A kind of audio signal processing method, device and electronic equipment
CN107144819A (en) * 2017-04-10 2017-09-08 北京猎户星空科技有限公司 A kind of sound localization method, device and electronic equipment
WO2017190552A1 (en) * 2016-05-03 2017-11-09 深圳光启合众科技有限公司 Robot and determination method and device for sound source position
CN107464564A (en) * 2017-08-21 2017-12-12 腾讯科技(深圳)有限公司 voice interactive method, device and equipment
CN107577449A (en) * 2017-09-04 2018-01-12 百度在线网络技术(北京)有限公司 Wake up pick-up method, device, equipment and the storage medium of voice
CN107680593A (en) * 2017-10-13 2018-02-09 歌尔股份有限公司 The sound enhancement method and device of a kind of smart machine

Patent Citations (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105556592A (en) * 2013-06-27 2016-05-04 亚马逊技术股份有限公司 Detecting self-generated wake expressions
CN103440313A (en) * 2013-08-27 2013-12-11 复旦大学 Music retrieval system based on audio fingerprint features
CN105045122A (en) * 2015-06-24 2015-11-11 张子兴 Intelligent household natural interaction system based on audios and videos
WO2017190552A1 (en) * 2016-05-03 2017-11-09 深圳光启合众科技有限公司 Robot and determination method and device for sound source position
CN106098075A (en) * 2016-08-08 2016-11-09 腾讯科技(深圳)有限公司 Audio collection method and apparatus based on microphone array
CN106653041A (en) * 2017-01-17 2017-05-10 北京地平线信息技术有限公司 Audio signal processing equipment and method as well as electronic equipment
CN106898360A (en) * 2017-04-06 2017-06-27 北京地平线信息技术有限公司 Acoustic signal processing method, device and electronic equipment
CN107146614A (en) * 2017-04-10 2017-09-08 北京猎户星空科技有限公司 A kind of audio signal processing method, device and electronic equipment
CN107144819A (en) * 2017-04-10 2017-09-08 北京猎户星空科技有限公司 A kind of sound localization method, device and electronic equipment
CN107132508A (en) * 2017-04-26 2017-09-05 杭州仁盈科技股份有限公司 Sound localization method and device
CN107464564A (en) * 2017-08-21 2017-12-12 腾讯科技(深圳)有限公司 voice interactive method, device and equipment
CN107577449A (en) * 2017-09-04 2018-01-12 百度在线网络技术(北京)有限公司 Wake up pick-up method, device, equipment and the storage medium of voice
CN107680593A (en) * 2017-10-13 2018-02-09 歌尔股份有限公司 The sound enhancement method and device of a kind of smart machine

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
李思含: "" 基于视音频信息融合的运动目标跟踪系统的设计与实现‘", 《中国优秀硕士学位论文全文数据库 信息科技辑》 *
桂雅骏: "" 一种融合音频和视频的室内智能监控系统"", 《计算机工程与应用》 *

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109286875A (en) * 2018-09-29 2019-01-29 百度在线网络技术(北京)有限公司 For orienting method, apparatus, electronic equipment and the storage medium of pickup
CN109286875B (en) * 2018-09-29 2021-01-01 百度在线网络技术(北京)有限公司 Method, apparatus, electronic device and storage medium for directional sound pickup
CN109473111A (en) * 2018-12-29 2019-03-15 苏州思必驰信息科技有限公司 A kind of voice enabling apparatus and method
CN109473111B (en) * 2018-12-29 2024-03-08 思必驰科技股份有限公司 Voice enabling device and method
CN113519022A (en) * 2019-02-27 2021-10-19 三星电子株式会社 Electronic device and control method thereof
CN110910878A (en) * 2019-11-27 2020-03-24 珠海格力电器股份有限公司 Voice wake-up control method and device, storage medium and household appliance
CN110910878B (en) * 2019-11-27 2022-02-11 珠海格力电器股份有限公司 Voice wake-up control method and device, storage medium and household appliance
CN111505583A (en) * 2020-05-07 2020-08-07 北京百度网讯科技有限公司 Sound source positioning method, device, equipment and readable storage medium

Also Published As

Publication number Publication date
CN108364648B (en) 2021-08-03

Similar Documents

Publication Publication Date Title
CN108322855A (en) Method and device for obtaining audio-frequency information
CN108364648A (en) Method and device for obtaining audio-frequency information
US10930281B2 (en) Method, apparatus and system for testing intelligent voice device
CN104049745A (en) Input control method and electronic device supporting the same
CN111752826A (en) Interface testing method and device, electronic equipment and storage medium
EP2945156A1 (en) Audio signal recognition method and electronic device supporting the same
CN108958634A (en) Express delivery information acquisition method, device, mobile terminal and storage medium
EP3698259A1 (en) Method and system for classifying time-series data
CN109242801A (en) Image processing method and device
CN107748879A (en) For obtaining the method and device of face information
WO2023116285A1 (en) Cross-link interference measurement method and apparatus, and medium and communication base station
CN109756241A (en) The determination of equipment body position
CN110493341A (en) Method and device for controlling devices
CN110070076A (en) Method and apparatus for choosing trained sample
CN110119354A (en) Method for testing software, device and electronic equipment based on Test cases technology
CN105700756B (en) The method for inputting the device and input information of information
CN109064464A (en) Method and apparatus for detecting battery pole piece burr
CN110096154A (en) For handling the method and device of information
Strohmayer et al. Wifi csi-based long-range through-wall human activity recognition with the esp32
US20150194145A1 (en) Computing system with command-sense mechanism and method of operation thereof
CN109144864A (en) Method and device for test window
CN110046670A (en) Feature vector dimension reduction method and device
CN109478237B (en) Light source identification method and device
CN113132051B (en) Reducing interference between electromagnetic tracking systems
CN108876466A (en) Method and apparatus for handling information

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant