CN111341313A - Vehicle-mounted multi-sound-zone sound source detection method, device and system - Google Patents
Vehicle-mounted multi-sound-zone sound source detection method, device and system Download PDFInfo
- Publication number
- CN111341313A CN111341313A CN202010143903.0A CN202010143903A CN111341313A CN 111341313 A CN111341313 A CN 111341313A CN 202010143903 A CN202010143903 A CN 202010143903A CN 111341313 A CN111341313 A CN 111341313A
- Authority
- CN
- China
- Prior art keywords
- audio information
- microphone
- vehicle
- sound
- pillar
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01H—MEASUREMENT OF MECHANICAL VIBRATIONS OR ULTRASONIC, SONIC OR INFRASONIC WAVES
- G01H17/00—Measuring mechanical vibrations or ultrasonic, sonic or infrasonic waves, not provided for in the preceding groups
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L25/00—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00
- G10L25/48—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 specially adapted for particular use
- G10L25/51—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 specially adapted for particular use for comparison or discrimination
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
- G10L2015/223—Execution procedure of a spoken command
Abstract
The invention provides a vehicle-mounted multi-sound-zone sound source detection method, device and system, which are used for acquiring audio information recorded by each radio device, acquiring multi-channel audio information, calculating and comparing awakening scores of the multi-channel audio information, acquiring audio information corresponding to the maximum awakening score, determining a sound zone where the audio information corresponding to the maximum awakening score is located, and determining the position of a sound source based on the sound zone. The method and the device realize the distinguishing of people at different positions in the vehicle, thereby achieving the purpose of better interactive experience and solving the problem that the command issued by a driver or the command issued by members at other positions cannot be distinguished in the vehicle.
Description
Technical Field
The invention belongs to the technical field of voice recognition, and particularly relates to a vehicle-mounted multi-sound-zone sound source detection method, device and system.
Background
With the progress of scientific technology, artificial intelligence is continuously developed, and not only is the interaction between people limited, but also the interaction between people and intelligent equipment is more developed as the voice interaction technology is more mature, and at present, the voice interaction technology is applied to more fields. For example: the voice interaction technology is applied to the automobile field, and specifically, the voice interaction technology is applied to the automobile field, two microphones are placed on a control console of an automobile, and noise reduction processing is carried out in the direction of a driver, so that the success rate of voice interaction of the driver is improved.
Although members at other locations in the automobile may interact using two microphones, it is not possible to distinguish between commands issued by the driver or commands issued by members at other locations.
Disclosure of Invention
In view of this, the present invention provides a method, an apparatus, and a system for detecting a sound source in multiple sound zones on a vehicle, so as to distinguish people at different positions in the vehicle, thereby achieving a better interactive experience. The technical scheme is as follows:
the invention provides a vehicle-mounted multi-sound-zone sound source detection method, which is applied to a vehicle-mounted system comprising a plurality of radio devices, wherein each radio device forms a beam in one direction, and each beam corresponds to a sound zone, and the method comprises the following steps:
acquiring audio information recorded by each radio device to obtain multi-channel audio information;
calculating and comparing the awakening values of the multiple paths of audio information to obtain the audio information corresponding to the maximum awakening value;
and determining the sound zone where the audio information corresponding to the maximum awakening score is located, and determining the position of the sound source based on the sound zone.
Preferably, the calculating and comparing the wake-up scores of the multiple channels of audio information to determine the audio information corresponding to the maximum wake-up score includes:
calculating the signal-to-noise ratio of the plurality of paths of audio information;
and comparing the signal-to-noise ratios of the multiple paths of audio information, determining that the awakening score of the audio information with the highest signal-to-noise ratio is the maximum, and acquiring the audio information corresponding to the maximum awakening score.
Preferably, if a plurality of radio equipments of the vehicle-mounted system include 4 microphones, 4 microphones are integrated into a microphone array and are disposed on the top of the vehicle, and 4 microphones respectively form a beam in four directions, namely, the direction of the driver of the vehicle, the direction of the copilot, the left direction of the rear row and the right direction of the rear row, respectively, and the obtaining of the audio information recorded by each radio equipment obtains a plurality of paths of audio information, including:
and acquiring audio information recorded by 4 microphones in four directions, namely the direction of a driver of the automobile, the direction of a co-driver, the direction of the left side of the rear row and the direction of the right side of the rear row, to obtain 4 paths of audio information.
Preferably, if the plurality of radio devices of the vehicle-mounted system include a microphone array disposed on the console of the vehicle and composed of a first microphone and a second microphone, and a third microphone and a fourth microphone disposed on the rear B pillar of the vehicle, the first microphone forms a beam in the direction of the driver of the vehicle, the second microphone forms a beam in the direction of the copilot, the third microphone forms a beam in the direction of the left side of the rear, the fourth microphone forms a beam in the direction of the right side of the rear, and the obtaining of the audio information recorded by each radio device obtains multiple paths of audio information, including:
and respectively acquiring audio information recorded by the first microphone in the direction of a driver of the automobile, audio information recorded by the second microphone in the direction of a co-driver, audio information recorded by the third microphone in the left direction of the rear row, and audio information recorded by the fourth microphone in the right direction of the rear row to obtain 4 paths of audio information.
Preferably, if the plurality of sound receiving devices of the vehicle-mounted system include a first microphone disposed on a left a pillar of the vehicle, a second microphone disposed on a right a pillar of the vehicle, a third microphone disposed on a left B pillar of the vehicle, and a fourth microphone disposed on a right B pillar of the vehicle, the first microphone forms a beam in the left a pillar direction of the vehicle, the second microphone forms a beam in the right a pillar direction of the vehicle, the third microphone forms a beam in the left B pillar direction of the vehicle, the fourth microphone forms a beam in the right B pillar direction of the vehicle, the obtaining of the audio information recorded by each of the sound receiving devices obtains multiple paths of audio information, including:
the audio information recorded by the first microphone in the direction of the column A on the left side of the automobile, the audio information recorded by the second microphone in the direction of the column A on the right side of the automobile, the audio information recorded by the third microphone in the direction of the column B on the left side of the automobile, and the audio information recorded by the fourth microphone in the direction of the column B on the right side of the automobile are respectively acquired, so that 4 paths of audio information are obtained.
The second aspect of the present invention provides a vehicle-mounted multi-sound-zone sound source detection apparatus, which is applied to a vehicle-mounted system including a plurality of sound receiving devices, wherein each of the sound receiving devices forms a beam in one direction, and each of the beams corresponds to a sound zone, and the vehicle-mounted multi-sound-zone sound source detection apparatus includes:
the acquisition module is used for acquiring the audio information recorded by each radio device to obtain multi-channel audio information and inputting the multi-channel audio information to the awakening module;
the awakening module is used for calculating and comparing awakening scores of the multiple paths of audio information to obtain the audio information corresponding to the maximum awakening score;
and the determining module is used for determining the sound zone where the audio information corresponding to the maximum awakening score is located and determining the position of the sound source based on the sound zone.
Preferably, the wake-up module is specifically configured to calculate signal-to-noise ratios of the multiple channels of audio information, compare the signal-to-noise ratios of the multiple channels of audio information, determine that a wake-up score of the audio information with a highest signal-to-noise ratio is the largest, and acquire the audio information corresponding to the largest wake-up score.
The third aspect of the invention provides a vehicle-mounted system, which comprises any one of the vehicle-mounted multi-sound-zone sound source detection devices provided by the second aspect, and a plurality of sound receiving devices;
each radio receiving device at least forms a wave beam in one direction, each wave beam corresponds to a sound zone, and each radio receiving device is used for recording audio information of the corresponding sound zone and sending the recorded audio information to the vehicle-mounted multi-sound-zone sound source detection device;
the vehicle-mounted multi-sound zone sound source detection device is used for acquiring audio information recorded by each radio equipment to obtain multi-channel audio information, calculating and comparing the awakening scores of the multi-channel audio information, acquiring the audio information corresponding to the maximum awakening score, determining the sound zone where the audio information corresponding to the maximum awakening score is located, and determining the sound source position based on the sound zone.
Preferably, the plurality of sound receiving devices comprise 4 microphones, the 4 microphones are integrated into a microphone array and are arranged on the top of the automobile, and the 4 microphones respectively form a beam in four directions, namely, the direction of a driver of the automobile, the direction of a copilot, the left direction of a rear row and the right direction of the rear row;
or
The plurality of radio devices comprise a microphone array which is arranged on a console of the automobile and is composed of a first microphone and a second microphone, and a third microphone and a fourth microphone which are arranged on a B column of a rear row of the automobile, wherein the first microphone forms a beam in the direction of an automobile driver, the second microphone forms a beam in the direction of a co-driver, the third microphone forms a beam in the direction of the left side of the rear row, and the fourth microphone forms a beam in the direction of the right side of the rear row.
Preferably, the plurality of sound receiving devices comprises a first microphone arranged on a left a pillar of the automobile, a second microphone arranged on a right a pillar of the automobile, a third microphone arranged on a left B pillar of the automobile, and a fourth microphone arranged on a right B pillar of the automobile, wherein the first microphone forms a beam in the direction of the left a pillar of the automobile, the second microphone forms a beam in the direction of the right a pillar of the automobile, the third microphone forms a beam in the direction of the left B pillar of the automobile, and the fourth microphone forms a beam in the direction of the right B pillar of the automobile.
Compared with the prior art, the technical scheme provided by the invention has the following advantages:
the method comprises the steps of obtaining audio information recorded by each radio device to obtain multi-channel audio information, calculating and comparing awakening scores of the multi-channel audio information, obtaining audio information corresponding to the maximum awakening score, determining a sound zone where the audio information corresponding to the maximum awakening score is located, and determining the position of a sound source based on the sound zone. The method and the device realize the distinguishing of people at different positions in the vehicle, thereby achieving the purpose of better interactive experience and solving the problem that the command issued by a driver or the command issued by members at other positions cannot be distinguished in the vehicle.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below, and it is obvious that the drawings in the following description are some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to these drawings without creative efforts.
Fig. 1 is a flowchart of a vehicle-mounted multi-sound-zone sound source detection method according to an embodiment of the present invention;
fig. 2 is a flowchart illustrating that 4 microphones are integrated into a microphone array, which is disposed on the top of an automobile according to an embodiment of the present invention, and fig. 1 is illustrated;
fig. 3 is a flowchart illustrating fig. 1, where a microphone array formed by a first microphone and a second microphone and a third microphone and a fourth microphone arranged on a rear B pillar of an automobile are integrated into a microphone array on an automobile console according to an embodiment of the present invention;
fig. 4 is a flowchart illustrating fig. 1, wherein the first microphone is disposed on a left a pillar of an automobile, the second microphone is disposed on a right a pillar of the automobile, the third microphone is disposed on a left B pillar of the automobile, and the fourth microphone is disposed on a right B pillar of the automobile according to an embodiment of the present invention;
fig. 5 is a schematic structural diagram of a vehicle-mounted multi-sound-zone sound source detection device according to an embodiment of the present invention;
fig. 6 is a schematic structural diagram of a vehicle-mounted multi-zone sound source detection system according to an embodiment of the present invention.
Detailed Description
The invention provides a vehicle-mounted multi-sound-zone sound source detection method, device and system, which are used for solving the problem that the command issued by a driver or the command issued by members at other positions cannot be distinguished in a vehicle.
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, not all, embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
As can be seen from the background art, in the prior art, members at other positions in the automobile can interact with each other by using two microphones, but it is impossible to distinguish whether the instructions are issued by the driver or the instructions are issued by the members at other positions.
Therefore, the invention provides a vehicle-mounted multi-sound-zone sound source detection method, device and system, which are used for distinguishing people at different positions in a vehicle, so that the purpose of better interactive experience is achieved, and the problem that the command issued by a driver or the commands issued by members at other positions cannot be distinguished in the vehicle is solved.
As shown in fig. 1, a method for detecting a vehicle-mounted multi-sound-zone sound source according to an embodiment of the present invention is shown, and the method includes the following steps:
and S101, acquiring the audio information recorded by each radio equipment to obtain multi-channel audio information.
In the process of implementing S101 specifically, there are multiple radio devices, each radio device forms a beam in one direction, each beam corresponds to a sound zone, and is responsible for receiving and recording audio information at a position corresponding to the sound zone. And then, a basis is provided for calculating and comparing the awakening scores of the multi-channel audio information by acquiring the audio information recorded by each radio device.
And S102, calculating and comparing the awakening values of the multi-channel audio information, and acquiring the audio information corresponding to the maximum awakening value.
In the process of implementing S102 specifically, after obtaining each channel of audio information, the audio information is calculated to obtain a wake-up score corresponding to each channel of audio information, and then the wake-up scores corresponding to each channel of audio information are compared to determine the position of the sound source.
Specifically, the signal-to-noise ratio of the multi-channel audio information is calculated, the signal-to-noise ratio of the multi-channel audio information is compared, the maximum awakening score of the audio information with the highest signal-to-noise ratio is determined, and the audio information corresponding to the maximum awakening score is obtained.
The signal-to-noise ratio of each path of audio information is different, so that the awakening score of each path of audio information is different, and the higher the signal-to-noise ratio is, the larger the awakening score is. The signal to noise ratio is highest, which indicates that the radio equipment corresponding to the audio information with the maximum awakening score is closest to the user sending the audio in the car.
S103, determining the sound zone where the audio information corresponding to the maximum awakening score is located, and determining the position of the sound source based on the sound zone.
In the process of implementing S103 specifically, a path of audio information with the largest wake-up score is determined by comparing the signal-to-noise levels of multiple paths of audio information, and because each radio device forms a beam in one direction, and each beam corresponds to a sound zone, the sound zone corresponding to the radio device that receives the path of audio information with the largest wake-up score is the sound zone where the audio information corresponding to the largest wake-up score is located, and finally, the sound source position is determined according to the sound zone.
For example: the method comprises the steps that 4 paths of audio information, namely, audio information A, audio information B, audio information C and audio information D, exist, wherein the signal-to-noise ratio of the audio information A is 20db, the signal-to-noise ratio of the audio information B is 10db, the signal-to-noise ratio of the audio information C is 20db, and the signal-to-noise ratio of the audio information D is 90db, wherein the signal-to-noise ratio of the audio information D is highest, therefore, the maximum awakening score is determined to be the audio information D, the sound zone where the audio information D is located corresponding to the maximum awakening score is located.
According to the vehicle-mounted multi-sound-zone sound source detection method disclosed by the embodiment of the invention, the audio information recorded by each radio device is obtained, the multi-channel audio information is obtained, the awakening scores of the multi-channel audio information are calculated and compared, the audio information corresponding to the maximum awakening score is obtained, the sound zone where the audio information corresponding to the maximum awakening score is located is determined, and the sound source position is determined based on the sound zone. The method and the device realize the distinguishing of people at different positions in the vehicle, thereby achieving the purpose of better interactive experience and solving the problem that the command issued by a driver or the command issued by members at other positions cannot be distinguished in the vehicle.
Based on the method shown in fig. 1 in the above embodiment of the present invention, 4 sound receiving devices are taken as 4 microphones, and 4 microphones are integrated into a microphone array, which is disposed on the top of the automobile for example, as shown in fig. 2.
S201, acquiring audio information recorded by 4 microphones in four directions, namely, the direction of a driver of the automobile, the direction of a copilot, the direction of the left side of a rear row and the direction of the right side of the rear row, to obtain 4 paths of audio information.
In the process of implementing S201 specifically, if a plurality of radio devices of the vehicle-mounted system include 4 microphones, the 4 microphones are integrated into a microphone array, and are disposed on the top of the vehicle, and the 4 microphones respectively form a beam in four directions, namely, the driver direction, the copilot direction, the left-rear-row direction, and the right-rear-row direction, then audio information recorded by the 4 microphones in the four directions, namely, the driver direction, the copilot direction, the left-rear-row direction, and the right-rear-row direction, is acquired, so as to obtain 4 channels of audio information.
It should be noted that the number of the microphones in the microphone arrays is different according to different vehicle models and parking spaces, that is, the number of the microphones is matched with the parking spaces. Specifically, the setting is performed according to actual conditions.
For example: when the car is a 5-seat car, the microphone array needs 5 microphones, and for a 7-seat large-scale SUV (sports utility car), the microphone array needs 7 microphones to be arranged on the top of the car.
S202, calculating and comparing the awakening scores of the 4 paths of audio information, and acquiring the audio information corresponding to the maximum awakening score.
In the process of implementing S202 specifically, reference may be made to the embodiment of S102, which is not described herein again.
S203, determining the sound zone where the audio information corresponding to the maximum arousal score is located, and determining the position of the sound source based on the sound zone.
According to the vehicle-mounted multi-sound-zone sound source detection method disclosed by the embodiment of the invention, the audio information recorded by 4 microphones is obtained, 4 paths of audio information are obtained, the awakening scores of the 4 paths of audio information are calculated and compared, the audio information corresponding to the maximum awakening score is obtained, the sound zone where the audio information corresponding to the maximum awakening score is located is determined, and the sound source position is determined based on the sound zone. The method and the device realize the distinguishing of people at different positions in the vehicle, thereby achieving the purpose of better interactive experience and solving the problem that the command issued by a driver or the command issued by members at other positions cannot be distinguished in the vehicle.
Alternatively, based on the method shown in fig. 1 in the embodiment of the present invention, 4 microphones are 4 sound receiving devices, wherein a microphone array formed by a first microphone and a second microphone on the console of the vehicle and a third microphone and a fourth microphone arranged on the rear B pillar of the vehicle are integrated into one microphone array, as shown in fig. 3 for example.
S301, audio information recorded by a first microphone in the direction of a driver of the automobile, audio information recorded by a second microphone in the direction of a co-driver, audio information recorded by a third microphone in the left direction of the rear row and audio information recorded by a fourth microphone in the right direction of the rear row are respectively obtained, and 4 paths of audio information are obtained.
In the process of implementing S301 specifically, if the multiple sound receiving devices of the vehicle-mounted system include a microphone array formed by a first microphone and a second microphone disposed on the vehicle console, and a third microphone and a fourth microphone disposed on the rear B pillar of the vehicle, where the first microphone forms a beam in the direction of the driver of the vehicle, the second microphone forms a beam in the direction of the copilot, the third microphone forms a beam in the direction of the left side of the rear row, and the fourth microphone forms a beam in the direction of the right side of the rear row, the audio information recorded by the first microphone in the direction of the driver of the vehicle, the audio information recorded by the second microphone in the direction of the copilot, the audio information recorded by the third microphone in the direction of the left side of the rear row, and the audio information recorded by the fourth microphone in the direction of the right side of the rear row are obtained, so as to obtain 4 channels of audio information.
It should be noted that the B-pillar of the automobile is located at the junction of the front door and the rear door (hinge joint of the rear door), and the automobile includes an a-pillar and a C-pillar in addition to the B-pillar. The A column is positioned at the joint of a front windshield and a front door of the automobile (the hinge joint of the front door), and the C column is positioned at the joint of a rear door and a rear windshield of the automobile (the joint of the rear door and a trunk). Automobile A post, B post and C post are located the different positions of car respectively, and the effect lies in: in the car body structure, the position of the ABC column relates to the problems of overall arrangement, safety and driving comfort of the vehicle, and the ABC column not only supports the metal column on the roof of the cab, but also has an important protection effect on the members in the cab, namely the protection spirit of the driver.
When the vehicle rolls or overturns, the ABC column can effectively prevent the cab from being extruded and deformed, so that the strength of the ABC column is of great significance to the life in the vehicle.
On the other hand, the ABC pillar is also the "must-go path" for some devices such as part of the electrical wiring, safety belts (B-pillar), illuminated audio devices, and even airbags can be installed on it.
It should be noted that, according to different models, in addition to most of the cars including ABC pillars, some of the cars also include D pillars.
When a user in the automobile sends out audio from any position, the two microphones arranged on the console and the microphones arranged on the B columns on the left side and the right side of the automobile can simultaneously record audio information sent out by the user. The microphones at different positions distinguish people at different positions, so that the aim of better interactive experience is fulfilled.
S302, calculating and comparing the awakening scores of the 4 paths of audio information, and acquiring the audio information corresponding to the maximum awakening score.
S303, determining the sound zone where the audio information corresponding to the maximum awakening score is located, and determining the position of the sound source based on the sound zone.
According to the vehicle-mounted multi-sound-zone sound source detection method disclosed by the embodiment of the invention, the audio information recorded by 4 microphones is obtained, 4 paths of audio information are obtained, the awakening scores of the 4 paths of audio information are calculated and compared, the audio information corresponding to the maximum awakening score is obtained, the sound zone where the audio information corresponding to the maximum awakening score is located is determined, and the sound source position is determined based on the sound zone. The method and the device realize the distinguishing of people at different positions in the vehicle, thereby achieving the purpose of better interactive experience and solving the problem that the command issued by a driver or the command issued by members at other positions cannot be distinguished in the vehicle.
Optionally, based on the method shown in fig. 1 in the above embodiment of the present invention, 4 sound receiving devices are taken as 4 microphones, wherein the method includes a first microphone disposed on a left a pillar of an automobile, a second microphone disposed on a right a pillar of the automobile, a third microphone disposed on a left B pillar of the automobile, and a fourth microphone disposed on a right B pillar of the automobile, as shown in fig. 4 for example.
S401, audio information recorded by a first microphone in the direction of the left A column of the automobile, audio information recorded by a second microphone in the direction of the right A column of the automobile, audio information recorded by a third microphone in the direction of the left B column of the automobile and audio information recorded by a fourth microphone in the direction of the right B column of the automobile are respectively obtained, and 4 paths of audio information are obtained.
In the process of implementing S401 specifically, if the multiple radio devices of the onboard system include a first microphone disposed on the a pillar on the left side of the vehicle, a second microphone disposed on the a pillar on the right side of the vehicle, a third microphone disposed on the B pillar on the left side of the vehicle, and a fourth microphone disposed on the B pillar on the right side of the vehicle, where the first microphone forms a beam in the a pillar direction on the left side of the vehicle, the second microphone forms a beam in the a pillar direction on the right side of the vehicle, the third microphone forms a beam in the B pillar direction on the left side of the vehicle, and the fourth microphone forms a beam in the B pillar direction on the right side of the vehicle, then the audio information recorded by the first microphone in the a pillar direction on the left side of the vehicle, the audio information recorded by the second microphone in the a pillar direction on the right side of the vehicle, the audio information recorded by the third microphone in the B pillar direction on the left side of the vehicle, and the audio information recorded by the fourth microphone in the B pillar direction on the right side of the vehicle are, resulting in 4 channels of audio information.
S402, calculating and comparing the awakening scores of the 4 paths of audio information, and acquiring the audio information corresponding to the maximum awakening score.
And S403, determining the sound zone where the audio information corresponding to the maximum awakening score is located, and determining the position of the sound source based on the sound zone.
According to the vehicle-mounted multi-sound-zone sound source detection method disclosed by the embodiment of the invention, the audio information recorded by each radio device is obtained, the multi-channel audio information is obtained, the awakening scores of the multi-channel audio information are calculated and compared, the audio information corresponding to the maximum awakening score is obtained, the sound zone where the audio information corresponding to the maximum awakening score is located is determined, and the sound source position is determined based on the sound zone. The method and the device realize the distinguishing of people at different positions in the vehicle, thereby achieving the purpose of better interactive experience and solving the problem that the command issued by a driver or the command issued by members at other positions cannot be distinguished in the vehicle.
Based on the vehicle-mounted multi-sound-zone sound source detection method disclosed in the embodiment of the present invention in fig. 1, the embodiment of the present invention further discloses a vehicle-mounted multi-sound-zone sound source detection device 50, as shown in fig. 5, which is a schematic structural diagram of the vehicle-mounted multi-sound-zone sound source detection device 50 disclosed in the embodiment of the present invention, and the method includes: an acquisition module 51, a wake-up module 52 and a determination module 53.
The obtaining module 51 is configured to obtain audio information recorded by each radio device, obtain multiple channels of audio information, and input the multiple channels of audio information to the wakeup module.
And the awakening module 52 is configured to calculate and compare awakening scores of the multiple channels of audio information, and obtain the audio information corresponding to the maximum awakening score.
The wake-up module 52 is specifically configured to calculate signal-to-noise ratios of the multiple channels of audio information, compare the signal-to-noise ratios of the multiple channels of audio information, determine that a wake-up score of the audio information with the highest signal-to-noise ratio is the largest, and obtain the audio information corresponding to the largest wake-up score.
And the determining module 53 is configured to determine a sound zone where the audio information corresponding to the maximum arousal score is located, and determine a sound source position based on the sound zone.
According to the vehicle-mounted multi-sound-zone sound source detection device disclosed by the embodiment of the invention, the audio information recorded by each radio equipment is obtained, the multi-channel audio information is obtained, the awakening scores of the multi-channel audio information are calculated and compared, the audio information corresponding to the maximum awakening score is obtained, the sound zone where the audio information corresponding to the maximum awakening score is located is determined, and the sound source position is determined based on the sound zone. The method and the device realize the distinguishing of people at different positions in the vehicle, thereby achieving the purpose of better interactive experience and solving the problem that the command issued by a driver or the command issued by members at other positions cannot be distinguished in the vehicle.
Based on the vehicle-mounted multi-sound zone sound source detection method disclosed in the embodiment of the present invention in fig. 1, the embodiment of the present invention further discloses a vehicle-mounted multi-sound zone sound source detection system 60, as shown in fig. 6, which is a schematic structural diagram of the vehicle-mounted multi-sound zone sound source detection system 60 provided in the embodiment of the present invention, and includes: a vehicle-mounted multi-sound-zone sound source detection device 50, and a plurality of sound receiving apparatuses 61. It should be noted that each sound receiving device 61 forms at least one beam in one direction, and each beam corresponds to one sound zone.
Each radio receiving device 61 is configured to record audio information of a corresponding sound zone and transmit the recorded audio information to the vehicle-mounted multi-sound-zone sound source detection apparatus 50.
The vehicle-mounted multi-sound-zone sound source detection device 50 is configured to acquire audio information recorded by each radio device 61, obtain multi-channel audio information, calculate and compare wake-up scores of the multi-channel audio information, acquire audio information corresponding to a maximum wake-up score, determine a sound zone where the audio information corresponding to the maximum wake-up score is located, and determine a sound source position based on the sound zone.
Optionally, the plurality of radio devices 61 include 4 microphones, the 4 microphones are integrated into a microphone array and are disposed on the top of the vehicle, and the 4 microphones respectively form a beam in four directions, namely, the driver direction, the copilot direction, the left direction of the rear row and the right direction of the rear row.
Alternatively, the plurality of sound receiving devices 61 includes a microphone array formed by a first microphone and a second microphone disposed on the console of the vehicle, wherein the first microphone forms a beam in the direction of the driver of the vehicle, the second microphone forms a beam in the direction of the co-driver, the third microphone forms a beam in the direction of the left side of the rear row, and the fourth microphone forms a beam in the direction of the right side of the rear row.
Optionally, the plurality of radio devices 61 includes a first microphone disposed on the a pillar on the left side of the automobile, a second microphone disposed on the a pillar on the right side of the automobile, a third microphone disposed on the B pillar on the left side of the automobile, and a fourth microphone disposed on the B pillar on the right side of the automobile, where the first microphone forms a beam in the a pillar direction on the left side of the automobile, the second microphone forms a beam in the a pillar direction on the right side of the automobile, the third microphone forms a beam in the B pillar direction on the left side of the automobile, and the fourth microphone forms a beam in the B pillar direction on the right side of the automobile.
According to the vehicle-mounted multi-sound zone sound source detection system disclosed by the embodiment of the invention, the audio information recorded by each radio device is obtained, the multi-channel audio information is obtained, the awakening scores of the multi-channel audio information are calculated and compared, the audio information corresponding to the maximum awakening score is obtained, the sound zone where the audio information corresponding to the maximum awakening score is located is determined, and the sound source position is determined based on the sound zone. The method and the device realize the distinguishing of people at different positions in the vehicle, thereby achieving the purpose of better interactive experience and solving the problem that the command issued by a driver or the command issued by members at other positions cannot be distinguished in the vehicle.
It should be noted that, in the present specification, the embodiments are all described in a progressive manner, each embodiment focuses on differences from other embodiments, and the same and similar parts among the embodiments may be referred to each other. For the device-like embodiment, since it is basically similar to the method embodiment, the description is simple, and for the relevant points, reference may be made to the partial description of the method embodiment.
Finally, it should also be noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.
The previous description of the disclosed embodiments is provided to enable any person skilled in the art to make or use the present invention. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other embodiments without departing from the spirit or scope of the invention. Thus, the present invention is not intended to be limited to the embodiments shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.
The foregoing is only a preferred embodiment of the present invention, and it should be noted that, for those skilled in the art, various modifications and decorations can be made without departing from the principle of the present invention, and these modifications and decorations should also be regarded as the protection scope of the present invention.
Claims (10)
1. A vehicle-mounted multi-sound-zone sound source detection method is applied to a vehicle-mounted system comprising a plurality of sound receiving devices, each sound receiving device forms a beam in one direction, and each beam corresponds to a sound zone, and the method comprises the following steps:
acquiring audio information recorded by each radio device to obtain multi-channel audio information;
calculating and comparing the awakening values of the multiple paths of audio information to obtain the audio information corresponding to the maximum awakening value;
and determining the sound zone where the audio information corresponding to the maximum awakening score is located, and determining the position of the sound source based on the sound zone.
2. The method according to claim 1, wherein the calculating and comparing wake-up scores of the multiple audio information to determine the audio information corresponding to the largest wake-up score comprises:
calculating the signal-to-noise ratio of the plurality of paths of audio information;
and comparing the signal-to-noise ratios of the multiple paths of audio information, determining that the awakening score of the audio information with the highest signal-to-noise ratio is the maximum, and acquiring the audio information corresponding to the maximum awakening score.
3. The method according to claim 1 or 2, wherein if the plurality of sound-collecting devices of the vehicle-mounted system includes 4 microphones, the 4 microphones are integrated into a microphone array and are disposed on the top of the vehicle, the 4 microphones respectively form a beam in four directions, namely, a driver direction, a passenger direction, a left-rear-row direction and a right-rear-row direction, and the obtaining the audio information recorded by each sound-collecting device to obtain multiple paths of audio information comprises:
and acquiring audio information recorded by 4 microphones in four directions, namely the direction of a driver of the automobile, the direction of a co-driver, the direction of the left side of the rear row and the direction of the right side of the rear row, to obtain 4 paths of audio information.
4. The method according to claim 1 or 2, wherein if the plurality of sound pickup devices of the on-board vehicle system includes a microphone array formed by a first microphone and a second microphone disposed on the console of the vehicle and a third microphone and a fourth microphone disposed on the rear B pillar of the vehicle, the first microphone forms a beam in the direction of the driver of the vehicle, the second microphone forms a beam in the direction of the co-driver, the third microphone forms a beam in the direction of the left side of the rear row, and the fourth microphone forms a beam in the direction of the right side of the rear row, the obtaining the audio information included in each sound pickup device to obtain multiple audio information comprises:
and respectively acquiring audio information recorded by the first microphone in the direction of a driver of the automobile, audio information recorded by the second microphone in the direction of a co-driver, audio information recorded by the third microphone in the left direction of the rear row, and audio information recorded by the fourth microphone in the right direction of the rear row to obtain 4 paths of audio information.
5. The method according to claim 1 or 2, wherein if the plurality of sound receivers of the in-vehicle system include a first microphone disposed on a left a-pillar of the vehicle, a second microphone disposed on a right a-pillar of the vehicle, a third microphone disposed on a left B-pillar of the vehicle, and a fourth microphone disposed on a right B-pillar of the vehicle, the first microphone forms a beam in a left a-pillar direction of the vehicle, the second microphone forms a beam in a right a-pillar direction of the vehicle, the third microphone forms a beam in a left B-pillar direction of the vehicle, and the fourth microphone forms a beam in a right B-pillar direction of the vehicle, the obtaining the audio information recorded by each of the sound receivers to obtain a plurality of audio information comprises:
the audio information recorded by the first microphone in the direction of the column A on the left side of the automobile, the audio information recorded by the second microphone in the direction of the column A on the right side of the automobile, the audio information recorded by the third microphone in the direction of the column B on the left side of the automobile, and the audio information recorded by the fourth microphone in the direction of the column B on the right side of the automobile are respectively acquired, so that 4 paths of audio information are obtained.
6. A vehicle-mounted multi-sound zone sound source detection device is applied to a vehicle-mounted system comprising a plurality of sound receiving devices, each sound receiving device forms a wave beam in one direction, each wave beam corresponds to a sound zone, and the vehicle-mounted multi-sound zone sound source detection device comprises:
the acquisition module is used for acquiring the audio information recorded by each radio device to obtain multi-channel audio information and inputting the multi-channel audio information to the awakening module;
the awakening module is used for calculating and comparing awakening scores of the multiple paths of audio information to obtain the audio information corresponding to the maximum awakening score;
and the determining module is used for determining the sound zone where the audio information corresponding to the maximum awakening score is located and determining the position of the sound source based on the sound zone.
7. The apparatus according to claim 6, wherein the wake-up module is specifically configured to calculate signal-to-noise ratios of the multiple channels of audio information, compare the signal-to-noise ratios of the multiple channels of audio information, determine that a wake-up score of the audio information with a highest signal-to-noise ratio is the largest, and obtain the audio information corresponding to the largest wake-up score.
8. An in-vehicle system characterized by comprising the in-vehicle multi-zone sound source detecting apparatus of claim 6 or 7, and a plurality of sound receiving devices;
each radio receiving device at least forms a wave beam in one direction, each wave beam corresponds to a sound zone, and each radio receiving device is used for recording audio information of the corresponding sound zone and sending the recorded audio information to the vehicle-mounted multi-sound-zone sound source detection device;
the vehicle-mounted multi-sound zone sound source detection device is used for acquiring audio information recorded by each radio equipment to obtain multi-channel audio information, calculating and comparing the awakening scores of the multi-channel audio information, acquiring the audio information corresponding to the maximum awakening score, determining the sound zone where the audio information corresponding to the maximum awakening score is located, and determining the sound source position based on the sound zone.
9. The vehicle-mounted system of claim 8, wherein the plurality of sound receiving devices comprises 4 microphones, the 4 microphones are integrated into a microphone array and are arranged on the top of the vehicle, and the 4 microphones respectively form a beam in four directions, namely, a driver direction, a co-driving direction, a left-side rear-row direction and a right-side rear-row direction;
or
The plurality of radio devices comprise a microphone array which is arranged on a console of the automobile and is composed of a first microphone and a second microphone, and a third microphone and a fourth microphone which are arranged on a B column of a rear row of the automobile, wherein the first microphone forms a beam in the direction of an automobile driver, the second microphone forms a beam in the direction of a co-driver, the third microphone forms a beam in the direction of the left side of the rear row, and the fourth microphone forms a beam in the direction of the right side of the rear row.
10. The in-vehicle system of claim 8, wherein the plurality of sound receiving devices comprises a first microphone disposed on a left a-pillar of the vehicle, a second microphone disposed on a right a-pillar of the vehicle, a third microphone disposed on a left B-pillar of the vehicle, and a fourth microphone disposed on a right B-pillar of the vehicle, wherein the first microphone forms a beam in the left a-pillar direction of the vehicle, the second microphone forms a beam in the right a-pillar direction of the vehicle, the third microphone forms a beam in the left B-pillar direction of the vehicle, and the fourth microphone forms a beam in the right B-pillar direction of the vehicle.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010143903.0A CN111341313A (en) | 2020-03-04 | 2020-03-04 | Vehicle-mounted multi-sound-zone sound source detection method, device and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010143903.0A CN111341313A (en) | 2020-03-04 | 2020-03-04 | Vehicle-mounted multi-sound-zone sound source detection method, device and system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111341313A true CN111341313A (en) | 2020-06-26 |
Family
ID=71187171
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010143903.0A Pending CN111341313A (en) | 2020-03-04 | 2020-03-04 | Vehicle-mounted multi-sound-zone sound source detection method, device and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111341313A (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111833899A (en) * | 2020-07-27 | 2020-10-27 | 腾讯科技（深圳）有限公司 | Voice detection method based on multiple sound zones, related device and storage medium |
| CN111986652A (en) * | 2020-07-31 | 2020-11-24 | 广州市凯泽利科技有限公司 | Vehicle-mounted intelligent voice system testing and evaluating method |
| US20220194389A1 (en) * | 2020-12-23 | 2022-06-23 | Hyundai Motor Company | Sound control apparatus for vehicles and method of controlling the same |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2007125449A1 (en) * | 2006-04-28 | 2007-11-08 | Koninklijke Philips Electronics N.V. | Device for and method of estimating directivity of a microphone arrangement |
| US20120197637A1 (en) * | 2006-09-21 | 2012-08-02 | Gm Global Technology Operations, Llc | Speech processing responsive to a determined active communication zone in a vehicle |
| CN108399916A (en) * | 2018-01-08 | 2018-08-14 | 蔚来汽车有限公司 | Vehicle intelligent voice interactive system and method, processing unit and storage device |
| CN109949810A (en) * | 2019-03-28 | 2019-06-28 | 华为技术有限公司 | A kind of voice awakening method, device, equipment and medium |
| CN110476208A (en) * | 2017-02-13 | 2019-11-19 | 伯斯有限公司 | Audio system and method for disturbing signal compensation |
| CN110556103A (en) * | 2018-05-31 | 2019-12-10 | 阿里巴巴集团控股有限公司 | Audio signal processing method, apparatus, system, device and storage medium |
| CN110673096A (en) * | 2019-09-30 | 2020-01-10 | 北京地平线机器人技术研发有限公司 | Voice positioning method and device, computer readable storage medium and electronic equipment |
-
2020
- 2020-03-04 CN CN202010143903.0A patent/CN111341313A/en active Pending
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2007125449A1 (en) * | 2006-04-28 | 2007-11-08 | Koninklijke Philips Electronics N.V. | Device for and method of estimating directivity of a microphone arrangement |
| US20120197637A1 (en) * | 2006-09-21 | 2012-08-02 | Gm Global Technology Operations, Llc | Speech processing responsive to a determined active communication zone in a vehicle |
| CN110476208A (en) * | 2017-02-13 | 2019-11-19 | 伯斯有限公司 | Audio system and method for disturbing signal compensation |
| CN108399916A (en) * | 2018-01-08 | 2018-08-14 | 蔚来汽车有限公司 | Vehicle intelligent voice interactive system and method, processing unit and storage device |
| CN110556103A (en) * | 2018-05-31 | 2019-12-10 | 阿里巴巴集团控股有限公司 | Audio signal processing method, apparatus, system, device and storage medium |
| CN109949810A (en) * | 2019-03-28 | 2019-06-28 | 华为技术有限公司 | A kind of voice awakening method, device, equipment and medium |
| CN110673096A (en) * | 2019-09-30 | 2020-01-10 | 北京地平线机器人技术研发有限公司 | Voice positioning method and device, computer readable storage medium and electronic equipment |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111833899A (en) * | 2020-07-27 | 2020-10-27 | 腾讯科技（深圳）有限公司 | Voice detection method based on multiple sound zones, related device and storage medium |
| CN111833899B (en) * | 2020-07-27 | 2022-07-26 | 腾讯科技（深圳）有限公司 | Voice detection method based on polyphonic regions, related device and storage medium |
| CN111986652A (en) * | 2020-07-31 | 2020-11-24 | 广州市凯泽利科技有限公司 | Vehicle-mounted intelligent voice system testing and evaluating method |
| US20220194389A1 (en) * | 2020-12-23 | 2022-06-23 | Hyundai Motor Company | Sound control apparatus for vehicles and method of controlling the same |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111341313A (en) | Vehicle-mounted multi-sound-zone sound source detection method, device and system | |
| CN107027170B (en) | System and method for determining a seating area | |
| US9832586B2 (en) | Vehicle and control method for the same | |
| DE102016212647B4 (en) | Method for operating a voice control system in an indoor space and voice control system | |
| CN110691299B (en) | Audio processing system, method, apparatus, device and storage medium | |
| DE102018127357A1 (en) | AUDIO WARNINGS FOR REMOTE ONLINE PARKING ASSISTANCE | |
| US20160221581A1 (en) | System and method for classifying a road surface | |
| US11643094B2 (en) | Noise control apparatus, vehicle having the same and method for controlling the vehicle | |
| DE19817780A1 (en) | Method and device for determining a deformation of a vehicle side part | |
| CN105513585B (en) | A kind of automobile active denoising method and system | |
| US10146317B2 (en) | Vehicle accessory operation based on motion tracking | |
| CN106611602A (en) | Vehicle sound collection apparatus and sound collection method | |
| CN110648663A (en) | Vehicle-mounted audio management method, device, equipment, automobile and readable storage medium | |
| DE102019128797A1 (en) | AUTHENTICATION FOR AN IN-VEHICLE DIGITAL ASSISTANT | |
| WO2017056706A1 (en) | Vehicle-mounted acoustic device | |
| JP2017069806A (en) | Speaker array device | |
| CN110737423A (en) | Method, device and equipment for regional audio broadcasting, storage medium and vehicle | |
| DE102018123359A1 (en) | ACCELERATION KNIFE-BASED EXTERNAL NOISE MONITORING DURING MANEUVERN AT LOW SPEED | |
| WO2017056707A1 (en) | Obstacle notification device and obstacle notification method | |
| WO2003016110A2 (en) | Method for assisting the user of a piece of equipment in locating a control element | |
| DE102021110593A1 (en) | Systems and methods for the detection and reproduction of the external environment | |
| WO2018116627A1 (en) | Occupant detection apparatus, occupant detection system, and occupant detection method | |
| KR101851144B1 (en) | Sound receiving apparatus, vehicle having the same and method for controlling the same | |
| KR20120099255A (en) | Compression formed trim panel with audio device | |
| US9721449B2 (en) | Vehicle keyfob locator system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |