WO2014080504A1 - 音検知装置及び方法、運転支援装置及び方法、並びに報知装置及び方法 - Google Patents
音検知装置及び方法、運転支援装置及び方法、並びに報知装置及び方法 Download PDFInfo
- Publication number
- WO2014080504A1 WO2014080504A1 PCT/JP2012/080384 JP2012080384W WO2014080504A1 WO 2014080504 A1 WO2014080504 A1 WO 2014080504A1 JP 2012080384 W JP2012080384 W JP 2012080384W WO 2014080504 A1 WO2014080504 A1 WO 2014080504A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- sound
- degree
- phase
- peripheral object
- driving support
- Prior art date
Links
Images
Classifications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S3/00—Direction-finders for determining the direction from which infrasonic, sonic, ultrasonic, or electromagnetic waves, or particle emission, not having a directional significance, are being received
- G01S3/80—Direction-finders for determining the direction from which infrasonic, sonic, ultrasonic, or electromagnetic waves, or particle emission, not having a directional significance, are being received using ultrasonic, sonic or infrasonic waves
- G01S3/802—Systems for determining direction or deviation from predetermined direction
- G01S3/808—Systems for determining direction or deviation from predetermined direction using transducers spaced apart and measuring phase or time difference between signals therefrom, i.e. path-difference systems
Definitions
- the present invention relates to a sound detection device and method, a driving support device and method, and a notification device and method.
- the degree of correlation between sound signals is not remarkable, for example, the sound from the local sound source is mixed with the ambient noise, the surrounding objects may not be detected accurately.
- the present invention intends to provide a sound detection device and method, a driving support device and method, and a notification device and method that can accurately detect a peripheral object based on the degree of temporal variation in the phase information of the sound signal. Is.
- the sound detection device provides temporal information on the phase information of a sound signal collected by at least two of the two or more sound collecting units and the two or more sound collecting units that are spaced apart from each other. And a peripheral object detection unit that detects a peripheral object based on the degree of variation. Thereby, even in a situation where the degree of correlation between sound signals is not remarkable, it is possible to accurately detect surrounding objects based on the degree of temporal variation of the phase information of the sound signals.
- the peripheral object detection unit is configured to adjust a temporal variation degree of the phase information obtained from at least one of a phase difference or a phase correlation between sound signals collected by at least two of the two or more sound collecting units. Based on this, peripheral objects may be detected.
- the peripheral object detection unit is a phase distribution time indicating a relationship between a phase difference between sound signals collected by at least two of the two or more sound collection units and a phase correlation between the sound signals in the phase difference.
- a peripheral object may be detected based on the degree of fluctuation.
- the peripheral object detection unit detects a peripheral object based on a temporal variation degree of a specific phase difference corresponding to a phase correlation peak between sound signals collected by at least two of the two or more sound collection units. It may be detected.
- the peripheral object detection unit may determine that there is a peripheral object serving as a local sound source as the degree of variation in the phase distribution is small.
- the peripheral object detection unit may determine that the peripheral object exists when the index indicating the degree of variation in the phase distribution is equal to or greater than the threshold value.
- the sound detection device further includes a threshold setting unit that sets a smaller threshold as the degree of variation in the phase distribution is smaller. It may be determined that an object exists.
- the sound detection device further includes a threshold setting unit that sets a smaller threshold as the specific phase difference corresponding to the peak of the phase distribution is larger, and the peripheral object detection unit has a peak value of the phase distribution. May be determined that there is a surrounding object.
- the peripheral object detection unit may determine that the peripheral object is present as the specific phase difference corresponding to the peak of the phase distribution increases.
- the peripheral object detection unit may easily determine that the peripheral object serving as the local sound source is closer as the specific phase difference variation degree is smaller.
- the peripheral object detection unit may easily determine that the peripheral object is approaching when the degree of variation in the specific phase difference decreases with time.
- the peripheral object detection unit may easily determine that the peripheral object serving as the local sound source is more detached as the degree of variation in the specific phase difference increases.
- the peripheral object detection unit may easily determine that the peripheral object is detached when the degree of variation in the specific phase difference increases with time.
- the sound detection device may be mounted on a vehicle.
- the sound detection method collects sound at two or more positions separated from each other, and is based on a temporal variation degree of phase information of a sound signal collected at at least two of the two or more positions. Including detecting surrounding objects. Thereby, even in a situation where the degree of correlation between sound signals is not remarkable, it is possible to accurately detect surrounding objects based on the degree of temporal variation of the phase information of the sound signals.
- the driving support device is configured to provide temporal information on the phase information of sound signals collected by at least two of the two or more sound collecting units and the two or more sound collecting units that are spaced apart from each other.
- a driving support control unit that controls driving support of the vehicle based on the degree of variation.
- the driving support control unit may promote driving support as the degree of variation in the phase information is smaller.
- the driving support method collects sound at two or more positions separated from each other, and is based on a temporal variation degree of phase information of a sound signal collected at at least two of the two or more positions. Including controlling driving assistance of the vehicle. Thereby, even in a situation where the degree of correlation between sound signals is not remarkable, it is possible to control the driving assistance of the vehicle based on the degree of temporal variation of the phase information of the sound signals.
- the notification device is a temporal variation of phase information of a sound signal collected by at least two of two or more sound collecting units and two or more sound collecting units arranged apart from each other.
- a notification control unit that controls notification to the outside of the vehicle based on the degree.
- the notification method according to the present invention collects sound at two or more positions separated from each other, and the vehicle is based on a temporal variation degree of phase information of a sound signal collected at at least two of the two or more positions. And controlling notification to the outside. Thereby, even when the degree of correlation between the sound signals is not remarkable, it is possible to control notification to the outside of the vehicle based on the degree of temporal variation of the phase information of the sound signals.
- a sound detection device and method a driving support device and method, and a notification device and method that can accurately detect a peripheral object based on a temporal variation degree of phase information of a sound signal. it can.
- the sound detection apparatus and method detect surrounding objects based on the degree of temporal variation in phase information of sound signals collected at at least two of two or more positions separated from each other.
- the driving support apparatus and method controls driving support of a vehicle based on a temporal variation degree of phase information of sound signals collected at at least two of two or more positions separated from each other.
- the notification device and method controls notification to the outside of the vehicle based on the degree of temporal variation in the phase information of the sound signal collected at at least two of two or more positions separated from each other.
- the temporal variation degree of the phase information of the sound signal means the temporal variation degree of the phase information obtained from at least one of the phase difference between the sound signals or the phase correlation.
- the driving support device and method and the notification device and method also have aspects as a sound detection device and method.
- the sound detection apparatus and method which concern on embodiment of this invention shall also be demonstrated using description of the driving assistance apparatus and method which concerns on embodiment of this invention, and an alerting
- the temporal distribution of the phase distribution indicating the relationship between the phase difference between the sound signals collected by at least two of the two or more sound collecting units and the phase correlation between the sound signals in the same phase difference.
- the vehicle driving assistance is performed based on the degree of fluctuation.
- the degree of variation of the phase distribution is determined using, for example, a stability index described later.
- FIG. 1 is a block diagram showing a driving support apparatus according to the first embodiment.
- the driving support device is mounted on a vehicle, and is configured around an electronic control unit 20 (hereinafter abbreviated as ECU 20) that supports driving of the vehicle.
- ECU 20 electronice control unit 20
- the microphone array 11 is connected to the ECU 20.
- the microphone array 11 constitutes two or more sound collecting units that are spaced apart from each other.
- the microphone array 11 includes, for example, one or more microphones 11a and 11b arranged on the left and right sides of the front surface of the vehicle.
- the ECU 20 receives an external sound signal collected by the microphones 11a and 11b.
- the sound signal is processed and input by, for example, a microphone amplifier, a band pass filter, an A / D converter, or the like.
- a microphone amplifier for example, a microphone amplifier, a band pass filter, an A / D converter, or the like.
- the driving support execution unit 12 is connected to the ECU 20.
- the driving support execution unit 12 includes a human-machine interface (hereinafter abbreviated as HMI) and an actuator.
- HMI human-machine interface
- the HMI for example, a monitor, a speaker, a vibrator or the like is used.
- the HMI is used to provide notification support to the driver of the vehicle using visual information, auditory information, and tactile information.
- a brake actuator, a steering actuator, a seat belt actuator, or the like is used as the actuator.
- the actuator is used to control a brake device, a steering device, and a seat belt device to perform driving support for avoiding a collision with surrounding objects and driving support for stabilizing vehicle behavior.
- the notification support includes alerting the driver and prompting the driver to perform a predetermined driving operation.
- Collision avoidance includes collision avoidance by braking intervention and collision avoidance by steering intervention.
- the braking intervention includes, for example, automatic braking and assistance for braking force
- the steering intervention includes automatic steering and assistance for steering.
- the ECU20 is provided with the phase information calculation part 21, the variation degree calculation part 22, and the driving assistance control part 23.
- the ECU 20 is configured mainly by a CPU, ROM, RAM, and the like, and realizes the functions of the phase information calculation unit 21, the variation degree calculation unit 22, and the driving support control unit 23 through execution of a program by the CPU. Note that the functions of the phase information calculation unit 21, the variation degree calculation unit 22, and the driving support control unit 23 may be realized by two or more ECUs.
- the phase information calculation unit 21 calculates phase information of an external sound signal collected by the microphones 11a and 11b.
- the phase information calculation unit 21 calculates a phase distribution indicating a relationship between a phase difference between sound signals collected by at least two of the two or more sound collection units and a phase correlation between the sound signals in the same phase difference. To do.
- the first sound signal is collected by one sound collecting unit
- the second sound signal is collected by the other sound collecting unit
- the second sound signal is delayed by a plurality of delay amounts. It is calculated by obtaining the phase correlation between the sound signal and the second sound signal delayed by each delay amount.
- the phase correlation is obtained, for example, as a general cross-correlation coefficient (GCC-PHAT) in order to whiten the target sound and calculate the cross-correlation function using only the phase component.
- GCC-PHAT general cross-correlation coefficient
- the phase distribution is calculated as a discrete data group indicating the relationship between the phase difference and the phase correlation at the same phase difference, and is represented as a graph with the phase difference corresponding to the delay amount as one axis and the phase correlation as the other axis.
- the variation degree calculation unit 22 calculates the temporal variation degree of the phase information calculated by the phase information calculation unit 21.
- the fluctuation degree calculation unit 22 calculates the temporal fluctuation degree of the phase distribution described above.
- the degree of variation in the phase distribution is expressed using, for example, a change in distribution shape, a change in distribution position in the phase difference direction, a stability index, a variance in time series information of phase correlation, and a difference between the maximum value and the minimum value. .
- the stability index S includes the vector of the phase correlation R 12 ( ⁇ , t) at the time t and the phase correlation R 12 ( ⁇ , t ⁇ t) at the time t ⁇ t, as shown in the equation (1). It is obtained as a direction cosine with the vector of The stability index shows a larger value as the degree of variation of the phase distribution is smaller.
- the driving support control unit 23 controls driving support based on the variation degree calculated by the variation degree calculation unit 22.
- the driving support control unit 23 also functions as a peripheral object detection unit that detects a peripheral object based on the temporal variation degree of the phase information of the sound signal collected by at least two of the two or more sound collection units. To do.
- the driving support control unit 23 determines the presence of the surrounding object by determining the sound and the surrounding noise from the surrounding object such as the surrounding vehicle based on the variation degree of the phase distribution.
- the driving support control unit 23 determines that a surrounding object exists.
- the driving support control unit 23 does not determine that there is a surrounding object when the degree of variation in the phase distribution is not stable, for example, when the stability index is less than the threshold.
- the driving support control unit 23 determines that there is a surrounding object, the driving support control unit 23 controls the driving support execution unit 12 to execute driving support. If not, the driving support control unit 23 does not execute driving support. Note that the driving support control unit 23 may directly control driving support based on the degree of variation in the phase distribution without determining the presence of a peripheral object serving as a local sound source.
- FIG. 2 is a flowchart showing the driving support method according to the first embodiment.
- the driving support device repeatedly executes the process shown in FIG. 2 at a set cycle.
- the phase information calculation unit 21 calculates phase information of an external sound signal collected by the microphones 11a and 11b (S11).
- the phase information calculation unit 21 obtains a phase distribution indicating the relationship between the phase difference between sound signals and the phase correlation between sound signals at the same phase difference.
- the variation degree calculation unit 22 calculates the temporal variation degree of the phase information calculated by the phase information calculation unit 21 (S12).
- the variation degree calculation unit 22 calculates, for example, a stability index that indicates the temporal variation degree of the phase distribution.
- the driving support control unit 23 determines the presence of a surrounding object based on the degree of variation of the phase distribution (S13). The driving support control unit 23 is more likely to determine that the local sound source is present as the degree of variation in the phase distribution is smaller, or when the index indicating the degree of variation in the phase distribution, for example, the stability index is greater than or equal to the threshold, It is determined that a sound source exists.
- the driving assistance control part 23 controls the driving assistance execution part 12, and performs driving assistance (S14).
- the driving support control unit 23 promotes driving support as the degree of variation of the phase distribution is smaller, for example, as the stability index is larger.
- driving assistance is, for example, widening the detection range when detecting surrounding objects, increasing detection accuracy, lowering the detection threshold to relax the execution conditions of assistance, and speeding up the start timing of assistance. It is promoted by raising the level of support contents.
- FIG. 3 is a diagram illustrating an example of a situation where the driving support method according to the first embodiment is applied.
- driving assistance is performed by detecting the surrounding vehicle C1 based on the correlation between sound signals. .
- driving assistance such as alerting the driver, prompting a braking operation, automatic braking, and braking force assistance is performed.
- the surrounding vehicle C1 can be accurately detected based on a significant correlation appearing between the sound signals.
- the traveling sound of the surrounding vehicle C1 may be mixed with surrounding noise, so that there is no significant correlation between the sound signals, and the surrounding vehicle C1 may not be detected with high accuracy.
- FIG. 4 is a diagram schematically illustrating the degree of variation in the phase distribution when the surrounding vehicle is far and approaching. Each axis of FIG. 4 shows a delay amount corresponding to the phase difference tau, time t, the phase correlation R 12, respectively.
- the distribution position in the phase difference direction randomly changes due to the surrounding noise, and the peak value is relatively small. This is because the sound source direction cannot be determined because the power of the ambient noise changes randomly.
- the peak value includes a substantial peak value that approximates the peak value.
- FIG. 5 is a diagram showing the time variation of the stability index and the time variation of the degree of correlation between sound signals.
- the stability index is an example of an index indicating the temporal variation degree of the phase distribution.
- the distribution position of the phase distribution changes randomly as shown in FIG. 4A, and the peak value is relatively small.
- the peak value is relatively small.
- the stability index S indicates that the phase distribution is stable as shown in the second period P2 in FIG.
- FIG. 5 (b) shows the time variation of the correlation between sound signals, particularly the maximum value of the phase correlation.
- FIG. 5 shows the time change of the stability index and the time change of the maximum value of the phase correlation with reference to the same time.
- the degree of fluctuation of the phase distribution for example, the stability index S
- . 5 (a) and 5 (b) show the detection timing of surrounding vehicles in comparison with the case based on the stability index S and the case based on the maximum value of the phase correlation. As indicated by the detection timings of the two, by using the characteristics of the degree of variation of the phase distribution, it is possible to detect the surrounding vehicle with higher accuracy and earlier than when using the correlation characteristics between the signals.
- the relationship between the phase difference between the sound signals and the phase correlation between the sound signals in the same phase difference can be obtained even in a situation where the degree of correlation between the sound signals is not remarkable.
- Driving assistance can be performed based on the temporal variation degree of the phase distribution shown.
- the fluctuation characteristics of the phase distribution it is possible to detect a surrounding vehicle with higher accuracy and at a faster timing than when using the correlation characteristics between signals, and to perform driving support based on the detection result.
- the threshold is set to be smaller as the degree of variation of the phase distribution is smaller, and when the peak value of the phase distribution is equal to or greater than the threshold, it is determined that a surrounding object exists.
- the description which overlaps with 1st Embodiment is abbreviate
- FIG. 6 is a block diagram showing a driving support apparatus according to the second embodiment.
- the threshold value setting unit 33 is added to the ECU 30 corresponding to the ECU 20 of the driving support apparatus according to the first embodiment.
- the functions of the microphone array 11, the driving support execution unit 12, and the variation degree calculation unit 32 are the same as the corresponding configurations of the driving support device according to the first embodiment, and thus description thereof is omitted.
- the phase information calculation unit 31 obtains the peak value of the phase distribution together with the phase distribution indicating the relationship between the phase difference between the sound signals and the phase correlation between the sound signals in the same phase difference.
- the peak value includes a substantial peak value that approximates the peak value.
- the threshold setting unit 33 sets a threshold based on the variation degree calculated by the variation degree calculation unit 32.
- the threshold setting unit 33 sets the threshold smaller as the phase distribution becomes more stable. For example, the threshold setting unit 33 sets the threshold smaller as the stability index is larger.
- the driving support control unit 34 controls driving support based on the phase information calculated by the phase information calculating unit 31 and the threshold set by the threshold setting unit 33.
- the driving support control unit 34 determines the presence of the peripheral object by determining the sound and the peripheral noise from the peripheral object such as the peripheral vehicle based on the phase information and the threshold value.
- the driving support control unit 34 determines the presence of a surrounding object based on the peak value and threshold value of the phase distribution.
- the driving support control unit 34 determines that the surrounding object exists when the peak value of the phase distribution is equal to or greater than the threshold value, and does not determine that the surrounding object exists when it is less than the threshold value.
- the driving support control unit 34 controls the driving support execution unit 12 to execute driving support when it is determined that a surrounding object exists, and does not execute driving support when it is not determined. Note that the driving support control unit 34 may directly control driving support based on the peak value and threshold value of the phase distribution without determining the presence of a peripheral object serving as a local sound source.
- FIG. 7 is a flowchart showing a driving support method according to the second embodiment.
- the driving support device repeatedly executes the process shown in FIG. 7 at a set cycle.
- the phase information calculation unit 31 calculates the phase information of the external sound signal collected by the microphones 11a and 11b (S21).
- the phase information calculation unit 31 obtains a phase distribution indicating a relationship between a phase difference between sound signals and a phase correlation between sound signals at the same phase difference, and a peak value of the phase distribution.
- the variation degree calculation unit 32 calculates the temporal variation degree of the phase information calculated by the phase information calculation unit 21 (S22).
- the variation degree calculation unit 32 calculates, for example, a stability index indicating the temporal variation degree of the phase distribution.
- the threshold setting unit 33 sets the threshold smaller as the variation degree calculated by the variation degree calculation unit 32 is smaller (S23). For example, the threshold setting unit 33 sets the threshold smaller as the stability index is larger.
- the driving support control unit 34 determines the presence of the surrounding object based on the phase information and the threshold (S24). The driving support control unit 34 is more likely to determine that a local sound source is present as the degree of variation in the phase distribution is smaller, or the peak value of the phase distribution is equal to or greater than a threshold set based on an index indicating the degree of variation in the phase distribution. In the case, it is determined that a local sound source exists.
- the driving assistance control part 34 controls the driving assistance execution part 12, and performs driving assistance (S25).
- the driving support control unit 34 promotes driving support as the degree of variation in the phase distribution is smaller.
- the driving assistance is more easily performed as it is determined that a local sound source is present.
- the threshold is set to be smaller as the degree of variation in the phase distribution is smaller, and there is a surrounding object when the peak value of the phase distribution is equal to or greater than the threshold.
- detection sensitivity for surrounding objects can be increased.
- the detection timing of a surrounding object can be advanced.
- the threshold is set to be smaller as the degree of variation of the phase distribution is smaller and the specific phase difference corresponding to the peak of the phase correlation is larger, and when the peak value of the phase distribution is equal to or larger than the threshold, It differs from the second embodiment in that it is determined that an object exists.
- the description which overlaps with 2nd Embodiment is abbreviate
- FIG. 8 is a block diagram showing a driving support apparatus according to the third embodiment.
- the sound source direction calculation unit 43 is added to the ECU 40 corresponding to the ECU 20 of the driving support device according to the second embodiment in the driving support device.
- the functions of the microphone array 11, the driving support execution unit 12, the phase information calculation unit 41, the variation degree calculation unit 42, and the driving support control unit 45 are the same as the corresponding configurations of the driving support device according to the second embodiment. The description is omitted.
- the sound source direction calculation unit 43 calculates the sound source direction based on the phase information calculated by the phase information calculation unit 41.
- the sound source direction calculation unit 43 calculates the sound source direction based on the phase difference corresponding to the peak of the phase distribution.
- the sound source direction ⁇ is calculated with reference to the front direction of the vehicle using equations (2) and (3) as shown in FIG.
- ⁇ ′ is the phase difference (delay amount) corresponding to the peak of the phase distribution
- f is the sampling frequency of the sound signal
- c the speed of sound
- ⁇ t the difference in arrival time of the sound signal between the microphones 11a and 11b
- d the microphone 11a.
- 11b the difference in arrival distance of sound signals between the microphones 11a and 11b, and dmic.
- ⁇ t ⁇ ′ / f (2)
- ⁇ sin ⁇ 1 (c ⁇ ⁇ t / dmic) (3)
- the threshold setting unit 44 sets a threshold based on the variation degree calculated by the variation degree calculation unit 42 and the sound source direction calculated by the sound source direction calculation unit 43.
- the threshold setting unit 44 sets the threshold smaller as the phase distribution is more stable and the sound source direction is biased laterally with respect to the vehicle. For example, the threshold setting unit 44 sets the threshold smaller as the stability index is larger and the absolute value in the sound source direction is larger.
- FIG. 10 is a flowchart showing the driving support method according to the third embodiment.
- the driving support device repeatedly executes the process shown in FIG. 10 at a set cycle.
- the phase information calculation unit 41 calculates phase information of an external sound signal collected by the microphones 11a and 11b (S31).
- the phase information calculation unit 41 calculates a phase distribution indicating a relationship between a phase difference between sound signals and a phase correlation between sound signals at the same phase difference, and a peak value of the phase distribution.
- the peak value includes a substantial peak value that approximates the peak value.
- the variation degree calculation unit 42 calculates the temporal variation degree of the phase information calculated by the phase information calculation unit 41 (S32).
- the variation degree calculation unit 42 calculates, for example, a stability index indicating the temporal variation degree of the phase distribution.
- the sound source direction calculation unit 43 calculates the sound source direction based on the phase information calculated by the phase information calculation unit 41 (S33). The sound source direction calculation unit 43 calculates the sound source direction based on the phase difference corresponding to the peak of the phase distribution.
- the threshold setting unit 44 sets the threshold smaller as the variation degree calculated by the variation degree calculation unit 42 is smaller and the sound source direction calculated by the sound source direction calculation unit 43 is biased to the side (S34). For example, the threshold setting unit 44 sets the threshold smaller as the stability index is larger or as the absolute value of the sound source direction is larger.
- the driving support control unit 45 determines the presence of a surrounding object based on the phase information and the threshold (S35). The driving support control unit 45 is more likely to determine that a local sound source is present as the degree of variation in the phase distribution is smaller, or the peak value of the phase distribution is set based on an index indicating the degree of variation in the phase distribution and the sound source direction. When it is above, it is determined that a local sound source exists.
- the driving support control unit 45 easily determines that a local sound source exists as the degree of fluctuation of a specific phase difference, that is, the degree of fluctuation of the sound source direction decreases.
- the driving support control unit 45 easily determines that the local sound source is present as the sound source direction is deviated from the reference direction corresponding to the sound collection direction of the microphone array 11, that is, from the front direction of the vehicle to the side.
- the directivity characteristic of the microphone array 11 may be set in a direction away from the front direction.
- the driving assistance control part 45 controls the driving assistance execution part 12, and performs driving assistance (S36).
- the driving support control unit 45 promotes driving support as the degree of variation in the phase distribution is smaller.
- the peak value of the phase distribution becomes larger as the degree of variation of the phase distribution is smaller. Therefore, it is easier to determine that a local sound source is present, and thus driving assistance is more easily performed.
- FIG. 11 is a diagram illustrating an example of a situation where the driving support method according to the third embodiment is applied.
- the sound source direction ⁇ is set with the front of the host vehicle C0 being 0 ° and the left and right sides being ⁇ 90 ° and 90 °, respectively.
- the ambient noise has an unstable phase distribution, and the sound source direction ⁇ changes to the left and right within a narrow range R in front of the host vehicle C0.
- the traveling sound of the approaching peripheral vehicle C1 has a stable phase distribution, and the sound source direction ⁇ is biased to the side of the host vehicle C0, for example, ⁇ 1 and ⁇ 2 in the figure. That is, when the phase distribution is stable and the sound source direction ⁇ is biased to the side of the host vehicle C0, the possibility that the sound source is the surrounding vehicle C1 approaching the host vehicle C0 is high.
- FIG. 12 shows the results of experiments on the detection timing of surrounding vehicles, comparing the case where the direction of the sound source is considered and the case where it is not considered in setting the threshold. As shown in FIG. 12, when the direction of the sound source is taken into consideration, it is confirmed that the detection timing of the surrounding vehicle is advanced by about 2 seconds compared to the case where the direction is not taken into consideration.
- the threshold value is set to be smaller as the degree of variation of the phase distribution is smaller and the specific phase difference corresponding to the peak of the phase correlation is larger.
- the value is equal to or greater than the threshold value, it is possible to further increase the detection sensitivity for the peripheral object by determining that the peripheral object exists. Thereby, the detection timing of a surrounding object can be further advanced.
- the driving support apparatus and method according to the fourth embodiment is a temporal variation of a specific phase difference corresponding to a peak of phase correlation between sound signals collected by at least two of the two or more sound collecting units.
- the driving assistance of the vehicle is performed based on the degree, that is, the temporal fluctuation degree of the sound source direction.
- the approaching or leaving of a surrounding object is determined based on the degree of fluctuation in the sound source direction.
- FIG. 13 is a block diagram showing a driving support apparatus according to the fourth embodiment.
- the driving support device is mounted on a vehicle, and is configured around an electronic control unit 50 (hereinafter abbreviated as ECU 50) that supports driving of the vehicle.
- ECU 50 electronice control unit 50
- the microphone array 11 is connected to the ECU 50.
- the microphone array 11 constitutes two or more sound collecting units that are spaced apart from each other.
- the microphone array 11 includes, for example, one or more microphones 11a and 11b arranged on the left and right sides of the front surface of the vehicle.
- the ECU 50 receives an external sound signal collected by the microphones 11a and 11b.
- the sound signal is processed and input by, for example, a microphone amplifier, a band pass filter, an A / D converter, or the like.
- a microphone amplifier for example, a microphone amplifier, a band pass filter, an A / D converter, or the like.
- the driving support execution unit 12 is connected to the ECU 40.
- the driving support execution unit 12 includes a human-machine interface (hereinafter abbreviated as HMI) and an actuator.
- HMI human-machine interface
- the HMI for example, a monitor, a speaker, a vibrator or the like is used.
- the HMI is used to provide notification support to the driver of the vehicle using visual information, auditory information, and tactile information.
- a brake actuator, a steering actuator, a seat belt actuator, or the like is used as the actuator.
- the actuator is used to control a brake device, a steering device, and a seat belt device to perform driving support for avoiding a collision with surrounding objects and driving support for stabilizing vehicle behavior.
- the notification support includes alerting the driver and prompting the driver to perform a predetermined driving operation.
- Collision avoidance includes collision avoidance by braking intervention and collision avoidance by steering intervention.
- the braking intervention includes, for example, automatic braking and assistance for braking force
- the steering intervention includes automatic steering and assistance for steering.
- the ECU 50 includes a phase information calculation unit 51, a sound source direction calculation unit 52, and a driving support control unit 53.
- the ECU 50 is configured mainly by a CPU, ROM, RAM, and the like, and realizes the functions of the phase information calculation unit 51, the sound source direction calculation unit 52, and the driving support control unit 53 through execution of a program by the CPU.
- the functions of the phase information calculation unit 51, the sound source direction calculation unit 52, and the driving support control unit 53 may be realized by two or more ECUs.
- the phase information calculation unit 51 calculates phase information of an external sound signal collected by the microphones 11a and 11b.
- the phase information calculation unit 51 calculates a specific phase difference corresponding to a peak of phase correlation between sound signals collected by at least two of the two or more sound collection units.
- the specific phase difference is obtained by collecting the first sound signal by one sound collecting unit and collecting the second sound signal by the other sound collecting unit, and delaying the second sound signal by a plurality of delay amounts. And calculating a phase distribution indicating a phase correlation between the first sound signal and the second sound signal delayed by each delay amount.
- the phase correlation is obtained, for example, as a general cross-correlation coefficient (GCC-PHAT) in order to whiten the target sound and calculate the cross-correlation function using only the phase component.
- GCC-PHAT general cross-correlation coefficient
- the sound source direction calculation unit 52 calculates the sound source direction based on the phase information calculated by the phase information calculation unit 51, and calculates the variation degree of the sound source direction.
- the variation degree of the sound source direction means the temporal dispersion of the sound source direction as well as the temporal variation degree of the sound source direction.
- the sound source direction calculation unit 52 calculates the sound source direction based on the phase difference corresponding to the peak of the phase correlation. That is, the sound source direction corresponds to a specific phase difference corresponding to a peak of phase correlation between sound signals collected by at least two of the two or more sound collecting units.
- the sound source direction ⁇ is calculated using equations (4) and (5) as shown in FIG.
- ⁇ ′ is the phase difference (delay amount) corresponding to the peak of the phase correlation
- f is the sampling frequency of the sound signal
- c is the speed of sound
- ⁇ t is the difference in arrival time of the sound signal between the microphones 11a and 11b
- d is the microphone 11a.
- 11b the difference in arrival distance of sound signals between the microphones 11a and 11b, and dmic.
- ⁇ t ⁇ ′ / f (4)
- ⁇ sin ⁇ 1 (c ⁇ ⁇ t / dmic) (5)
- the driving support control unit 53 controls driving support based on the variation degree of the sound source direction calculated by the sound source direction calculating unit 52.
- the driving support control unit 53 also functions as a peripheral object detection unit that detects a peripheral object based on the temporal variation degree of the phase information of the sound signal collected by at least two of the two or more sound collection units. To do. In particular, the driving support control unit 53 detects surrounding objects that are approaching or leaving the vehicle.
- the driving support control unit 53 determines approaching or leaving of a surrounding object based on the degree of variation in the sound source direction. For example, the driving support control unit 53 determines that the surrounding object is approaching or leaving when the variation degree of the sound source direction is less than the threshold value. On the other hand, the driving support control unit 53 does not determine that the surrounding object is approaching or leaving when, for example, the variation degree of the sound source direction is equal to or greater than the threshold value.
- the driving support control unit 53 may determine the approaching or leaving of the surrounding object based on the overall fluctuation tendency of the sound source direction calculated by the sound source direction calculating unit 52. Further, the driving support control unit 53 determines the approaching or leaving of the surrounding object based on the degree of correlation between the sound signals collected by the microphones 11a and 11b, for example, the correlation of the time series information of the power spectrum or the sound pressure. May be.
- the driving support control unit 53 determines that a surrounding object is approaching, the driving support control unit 53 controls the driving support execution unit 12 to execute driving support. do not do.
- the driving support control unit 53 may directly control driving support based on the degree of variation in the direction of the sound source without determining the approaching or leaving of a peripheral object serving as a local sound source.
- FIG. 15 is a flowchart showing a driving support method according to the fourth embodiment.
- the driving support device repeatedly executes the process shown in FIG. 15 at a set cycle.
- the phase information calculation unit 51 calculates the phase information of the external sound signal collected by the microphones 11a and 11b (S41).
- the phase information calculation unit 51 calculates a specific phase difference corresponding to the peak of the phase correlation between the sound signals collected by the microphones 11a and 11b.
- the sound source direction calculation unit 52 calculates the sound source direction based on the phase information calculated by the phase information calculation unit 51, and calculates the variation degree of the sound source direction (S42).
- the sound source direction calculation unit 52 obtains time change of the sound source direction, variance of the sound source direction, and the like.
- the driving support control unit 53 determines approaching or leaving of a surrounding object based on the degree of variation in the sound source direction (S43). For example, the driving support control unit 53 determines that the surrounding object is approaching or leaving when the variation degree of the sound source direction is less than the threshold value.
- the driving support control unit 53 can easily determine that the local sound source is approaching when the degree of fluctuation of the specific phase difference, that is, the degree of fluctuation of the sound source direction becomes smaller, or when the degree of fluctuation of the sound source direction becomes smaller with time. .
- the driving support control unit 53 controls the driving support execution unit 12 to execute driving support (S44).
- the driving support control unit 53 promotes driving support as the degree of fluctuation of a specific phase difference, that is, the degree of fluctuation of the sound source direction is smaller.
- driving assistance is, for example, widening the detection range when detecting surrounding objects, increasing detection accuracy, lowering the detection threshold to relax the execution conditions of assistance, and speeding up the start timing of assistance. It is promoted by raising the level of support contents.
- FIG. 16 is a diagram illustrating an example of a situation where the driving support method according to the fourth embodiment is applied.
- the driving is determined by determining whether the surrounding vehicle C1 is approaching or leaving based on the correlation between sound signals. Support is provided.
- the traveling sound of the surrounding vehicle C1 is mixed with the ambient noise, and thus no significant correlation appears between the sound signals, and the approaching or leaving of the surrounding vehicle C1 cannot be accurately determined. There is.
- FIG. 17 is a schematic diagram showing an example of the sound source direction and the temporal change of dispersion in relation to FIG.
- the sound source direction is set such that the front of the host vehicle is 0 °, the left side is ⁇ 90 °, and the right side is 90 °.
- the sound source direction ⁇ is changed from 90 ° to 0 ° as the approaching vehicle C1 approaches the front from the right side of the host vehicle C0, and from 0 ° to ⁇ 90 ° as the approaching vehicle C1 leaves the left side from the front. And it has fluctuated greatly as a whole.
- the overall variation tendency of the sound source direction ⁇ (the absolute value of the tangent slope of the trend line TL) increases as the approaching vehicle C1 approaches the front of the host vehicle C0 and decreases as the vehicle approaches the front.
- the degree of fluctuation of the sound source direction ⁇ decreases as the approaching vehicle C1 approaches the front of the host vehicle C0 and increases as it moves away from the front.
- the variance V in the sound source direction ⁇ also decreases as the approaching vehicle C1 approaches the front of the host vehicle C0, and increases as it moves away from the front. This is because, in an acoustic environment where ambient noise exists, the direction of the sound source is fixed due to the presence of a specific sound source such as the surrounding vehicle C1.
- the degree of variation in the sound source direction is smaller than the threshold value, it is possible to determine the approaching or leaving of the surrounding vehicle and perform driving support based on the determination result.
- the approaching or leaving of the surrounding vehicle may be determined in consideration of the overall fluctuation tendency of the sound source direction.
- the sound source direction fluctuation characteristics described above are not greatly affected by the magnitude of the sound pressure of the sound signal. For this reason, the variation characteristic of the sound source direction described above can be effectively used even when the microphone array 11 cannot properly detect the change in the sound pressure.
- the microphone array 11 even when the microphone array 11 hardly detects a change in sound pressure because the sound pressure of the surrounding sound is too high, the surrounding vehicle is approaching or leaving using the fluctuation characteristics of the sound source direction. It can be determined whether it is inside. If the approach or departure of the surrounding vehicle cannot be determined even if the same characteristic is used, for example, the driver of the vehicle is notified by notifying that the approaching or leaving of the approaching vehicle cannot be determined because the surrounding noise is too large. You may be alerted to.
- the degree of temporal variation of a specific phase difference corresponding to the peak of phase correlation between sound signals even in a situation where the degree of correlation between sound signals is not remarkable can be performed based on the degree of temporal fluctuation of the sound source direction.
- the approaching or leaving of the surrounding object can be determined based on the degree of variation in the sound source direction.
- the determination may be made based on the degree of variation in frequency. Good.
- the driving support apparatus and method according to the fifth embodiment is a temporal variation of a specific phase difference corresponding to a peak of phase correlation between sound signals collected by at least two of two or more sound collecting units.
- the vehicle driving assistance is performed based on the degree, that is, the temporal fluctuation degree of the sound source direction and the correlation degree between the sound signals.
- the approaching or leaving of a surrounding object is determined based on the degree of variation in the sound source direction and the correlation between sound signals.
- FIG. 18 is a block diagram showing a driving support apparatus according to the fifth embodiment.
- the driving support device is mounted on a vehicle, and is configured around an electronic control unit 60 (hereinafter abbreviated as ECU 60) that supports driving of the vehicle.
- ECU 60 electronice control unit 60
- the ECU 60 is connected to microphone arrays 11L and 11R.
- the microphone arrays 11L and 11R respectively constitute two or more sound collection units that are arranged apart from each other.
- the left-channel microphone array 11L includes microphones 11a and 11b that are spaced apart from each other on the left side of the front surface of the vehicle.
- the right channel microphone array 11R includes microphones 11a and 11b that are spaced apart from each other on the right front side of the vehicle.
- the ECU 60 receives an external sound signal collected by the microphones 11a and 11b.
- the sound signals of the left and right channels are processed and input by, for example, a microphone amplifier, a band pass filter, an A / D converter, and the like.
- the microphone arrays 11L and 11R are configured by microphones 11a and 11b, respectively, and the first sound signal collected and processed by the microphone 11a and the second sound signal processed by the microphone 11b are processed. Description will be made assuming that a sound signal is input.
- the driving support execution unit 12 is connected to the ECU 60.
- the driving support execution unit 12 includes a human-machine interface (hereinafter abbreviated as HMI) and an actuator.
- HMI human-machine interface
- the HMI for example, a monitor, a speaker, a vibrator or the like is used.
- the HMI is used to provide notification support to the driver of the vehicle using visual information, auditory information, and tactile information.
- a brake actuator, a steering actuator, a seat belt actuator, or the like is used as the actuator.
- the actuator is used to control a brake device, a steering device, and a seat belt device to perform driving support for avoiding a collision with surrounding objects and driving support for stabilizing vehicle behavior.
- the notification support includes alerting the driver and prompting the driver to perform a predetermined driving operation.
- Collision avoidance includes collision avoidance by braking intervention and collision avoidance by steering intervention.
- the braking intervention includes, for example, automatic braking and assistance for braking force
- the steering intervention includes automatic steering and assistance for steering.
- the ECU 60 includes a phase information calculation unit 61, a sound source direction calculation unit 62, a correlation information calculation unit 63, and a driving support control unit 64.
- the phase information calculation unit 61, the sound source direction calculation unit 62, and the correlation information calculation unit 63 correspond to the left and right channels, and the phase information calculation units 61L and 61R, the sound source direction calculation units 62L and 62R, and the correlation information calculation unit 63L, Two sets of 63R are provided.
- the ECU 60 is configured mainly by a CPU, ROM, RAM, and the like, and realizes the functions of the phase information calculation unit 61, the sound source direction calculation unit 62, the correlation information calculation unit 63, and the driving support control unit 64 through execution of a program by the CPU. .
- the functions of the phase information calculation unit 61, the sound source direction calculation unit 62, the correlation information calculation unit 63, and the driving support control unit 64 may be realized by two or more ECUs.
- the phase information calculation unit 61 calculates the phase information of the external sound signal collected by the microphones 11a and 11b constituting the microphone arrays 11L and 11R, respectively.
- the phase information calculation unit 61 calculates a specific phase difference corresponding to a peak of phase correlation between sound signals collected by at least two of the two or more sound collection units.
- the specific phase difference is obtained by collecting the first sound signal by one sound collecting unit and collecting the second sound signal by the other sound collecting unit, and delaying the second sound signal by a plurality of delay amounts. And calculating a phase distribution indicating a phase correlation between the first sound signal and the second sound signal delayed by each delay amount.
- the phase correlation is obtained, for example, as a general cross-correlation coefficient (GCC-PHAT) in order to whiten the target sound and calculate the cross-correlation function using only the phase component.
- GCC-PHAT general cross-correlation coefficient
- the sound source direction calculation unit 62 calculates the sound source direction based on the phase information calculated by the phase information calculation unit 61 and calculates the temporal variation degree of the sound source direction.
- the sound source direction calculation unit 62 calculates the sound source direction based on the phase difference corresponding to the peak of the phase correlation. That is, the sound source direction corresponds to a specific phase difference corresponding to a peak of phase correlation between sound signals collected by at least two of the two or more sound collecting units.
- the sound source direction ⁇ is calculated using equations (6) and (7) as shown in FIG.
- ⁇ ′ is the phase difference (delay amount) corresponding to the peak of the phase correlation
- f is the sampling frequency of the sound signal
- c is the speed of sound
- ⁇ t is the difference in arrival time of the sound signal between the microphones 11a and 11b
- d is the microphone 11a.
- 11b the difference in arrival distance of sound signals between the microphones 11a and 11b, and dmic.
- ⁇ t ⁇ ′ / f (6)
- ⁇ sin ⁇ 1 (c ⁇ ⁇ t / dmic) (7)
- Correlation information calculation unit 63 calculates correlation information of external sound signals collected by microphones 11a and 11b constituting microphone arrays 11L and 11R, respectively.
- the correlation information calculation unit 63 calculates a correlation value indicating the degree of correlation between the first sound signal and the second sound signal, for example, the degree of correlation of time series information of the power spectrum or the sound pressure.
- the driving support control unit 64 controls driving support based on the sound source direction calculated by the sound source direction calculating unit 62 and the correlation information calculated by the correlation information calculating unit 63.
- the driving support control unit 64 also functions as a peripheral object detection unit that detects a peripheral object based on the temporal variation degree of the phase information of the sound signal collected by at least two of the two or more sound collection units. To do. In particular, the driving support control unit 64 detects peripheral objects that are approaching or leaving the vehicle.
- the driving support control unit 64 determines the approaching or leaving of the surrounding object based on the sound source direction and the degree of fluctuation of the correlation information. For example, when it is determined that a nearby object is approaching, the driving support control unit 64 controls the driving support execution unit 12 to execute driving support. do not do. Note that the driving assistance control unit 64 may directly control driving assistance based on the direction of the sound source and the degree of variation in the correlation information without determining the approach or separation of a peripheral object serving as a local sound source.
- FIG. 20 is a flowchart showing a driving support method according to the fifth embodiment.
- the driving support device repeatedly executes the process shown in FIG. 20 at a set cycle.
- the phase information calculation unit 51 calculates the phase information of the external sound signal collected by the microphones 11a and 11b for each of the left and right channels (S51).
- the phase information calculation unit 61 calculates a specific phase difference corresponding to the peak of the phase correlation between the sound signals collected by the microphones 11a and 11b for each channel.
- the sound source direction calculation unit 62 calculates the sound source direction for each channel based on the phase information calculated by the phase information calculation unit 61, and calculates the variation degree of the sound source direction for each channel (S52).
- Correlation information calculation unit 63 calculates correlation information of external sound signals collected by microphones 11a and 11b for each of the left and right channels (S53). The correlation information calculation unit 63 calculates a correlation value indicating the degree of correlation between the first sound signal and the second sound signal for each channel.
- the driving support control unit 64 determines the approaching or leaving of the surrounding object based on the sound source direction and the degree of variation of the correlation information (S54). The driving support control unit 64 determines approaching or leaving of the surrounding object based on the sound source direction calculated by the sound source direction calculating unit 62 and the correlation information calculated by the correlation information calculating unit 63. The driving support control unit 64 determines the approaching or leaving of the surrounding object based on the sound source direction and the fluctuation tendency of the correlation value.
- the driving support control unit 64 determines whether the approach condition is satisfied based on the fluctuation tendency of the sound source direction of one channel.
- the approach condition is satisfied when the absolute value in the sound source direction is less than the first threshold value and less than the second threshold value that is smaller than the first threshold value within a predetermined time after the absolute value is less than the first threshold value.
- the driving support control unit 64 determines whether the separation condition is satisfied based on the sound source direction of the other channel and the fluctuation tendency of the correlation value.
- the separation condition is that the absolute value of the inclination of the sound source direction becomes less than the third threshold value, becomes less than or equal to the fourth threshold value after becoming less than the third threshold value, and the absolute value of the sound source direction becomes equal to or more than the fifth threshold value. It is established when the slope of is greater than or equal to the sixth threshold.
- the driving support control unit 64 indicates that the local sound source is disconnected when the degree of fluctuation of the specific phase difference, that is, the degree of fluctuation of the sound source direction increases, or when the degree of fluctuation of the specific phase difference increases with time. It is easy to judge.
- the driving assistance control part 64 controls the driving assistance execution part 12, and performs driving assistance (S55).
- the driving support control unit 64 promotes driving support as the degree of fluctuation of a specific phase difference, that is, the degree of fluctuation of the sound source direction is smaller.
- driving assistance is, for example, widening the detection range when detecting surrounding objects, increasing detection accuracy, lowering the detection threshold to relax the execution conditions of assistance, and speeding up the start timing of assistance. It is promoted by raising the level of support contents.
- FIG. 21 is a diagram illustrating an example of a situation where the driving support method according to the fifth embodiment is applied.
- the driving is determined by determining whether the surrounding vehicle C1 is approaching or leaving based on the correlation between the sound signals. Support is provided.
- the traveling sound of the surrounding vehicle C1 is mixed with the ambient noise, and thus no significant correlation appears between the sound signals, and the approaching or leaving of the surrounding vehicle C1 cannot be accurately determined. There is.
- FIG. 22 is a diagram showing the fluctuation direction of the sound source direction and the correlation value in relation to FIG.
- FIG. 22 shows the variation tendency of the correlation value CL calculated for the left channel together with the variation tendency of the absolute values of the sound source directions ⁇ L and ⁇ R calculated for the left and right channels.
- the traveling sound is collected by the right channel microphone array 11R before the left channel microphone array 11L.
- the absolute value of the sound source direction ⁇ R of the right channel is less than the first threshold value (for example, about 30 to 40 °) at time t1, and is less than the second threshold value (for example, about 0 °) at time t2. This indicates that the surrounding vehicle C1 is approaching the vicinity of the front of the host vehicle C0.
- the absolute value of the slope of the sound source direction ⁇ L of the left channel becomes less than the third threshold (about 0) at the time t3, and the fluctuation tendency of the sound source direction ⁇ L is an inflection point. Has reached. This represents that the surrounding vehicle C1 starts to leave from the vicinity of the front of the host vehicle C0.
- the absolute value of the inclination of the sound source direction ⁇ L becomes less than the fourth threshold value (about 0) at time t4
- the fluctuation tendency of the sound source direction ⁇ L reaches the inflection point
- the absolute value of the sound source direction ⁇ L becomes the fifth threshold value ( For example, about 60 °) or more.
- the slope of the correlation value CL of the left channel is equal to or greater than the sixth threshold (about 0), and the fluctuation of the correlation value CL reaches the inflection point. This indicates that the surrounding vehicle C1 is sufficiently separated from the host vehicle C0 and the separation is completed.
- the approaching or leaving of the surrounding vehicle based on the fluctuation direction of the sound source direction and the degree of correlation, it is possible to perform driving support of the own vehicle according to the approaching or leaving of the surrounding vehicle. Further, by determining the timing at which the surrounding vehicle starts to leave, the driving support for the surrounding vehicle can be terminated, and the driving support for the other surrounding vehicle can be started at an early timing. In addition, when the surrounding vehicle is far, the calculation accuracy of the sound source direction is lowered. However, since the fluctuation degree of the correlation degree is taken into consideration, it is possible to accurately determine the completion of the leaving of the surrounding vehicle.
- the specific phase difference corresponding to the peak of the phase correlation between sound signals that is, the time in the sound source direction.
- Driving assistance can be performed based on the degree of fluctuation and the correlation between sound signals.
- the approaching or leaving of the surrounding object can be determined based on the degree of variation in the sound source direction and the correlation between the sound signals.
- the sixth embodiment is different from the other embodiments in that the notification to the outside of the vehicle is controlled based on the temporal variation degree of the phase information of the sound signal.
- the notification device is mounted on the vehicle and notifies the other vehicle of the running state of the vehicle based on the temporal variation degree of the phase information of the sound signal.
- For the notification for example, an operation of a horn, blinking of a light, communication between vehicles, and the like are used.
- the notification operation is executed based on, for example, the stability index, the peak value of the phase distribution, and the degree of variation in the sound source direction.
- the notification to the outside of the vehicle is controlled based on the temporal variation degree of the phase information of the sound signal even when the degree of correlation between the sound signals is not remarkable. can do.
- the above-described embodiments have described the best embodiments of the sound detection device and method, the driving support device and method, and the notification device and method according to the present invention, and the sound detection device and method according to the present invention.
- the driving support device and method and the notification device and method are not limited to those described in the present embodiment.
- the sound detection device and method, the driving support device and method, and the notification device and method according to the present invention are the sound detection device and method according to the present embodiment and the driving support without departing from the gist of the invention described in each claim.
- the apparatus and method and the notification apparatus and method may be modified or applied to others.
- the microphone array 11 is configured by the two microphones 11a and 11b and the sound signal information of all the microphones constituting the microphone array 11 is used has been described.
- the microphone array is composed of three or more microphones
- the sound signal information of at least two of the microphones constituting the microphone array may be used.
- each of the microphone arrays 11L and 11R is composed of three or more microphones
- the sound signals of at least two microphones of the microphones constituting the microphone arrays 11L and 11R respectively. Information may be used.
Landscapes
- Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Radar, Positioning & Navigation (AREA)
- Remote Sensing (AREA)
- Traffic Control Systems (AREA)
- Measurement Of Velocity Or Position Using Acoustic Or Ultrasonic Waves (AREA)
- Geophysics And Detection Of Objects (AREA)
- Measurement Of Mechanical Vibrations Or Ultrasonic Waves (AREA)
Abstract
Description
Δt=τ´/f …(2)
θ=sin-1(c・Δt/dmic) …(3)
Δt=τ´/f …(4)
θ=sin-1(c・Δt/dmic) …(5)
Δt=τ´/f …(6)
θ=sin-1(c・Δt/dmic) …(7)
Claims (20)
- 互いに離隔して配置された2以上の集音部と、
前記2以上の集音部のうちの少なくとも2つにより集音された音信号の位相情報の時間的な変動度合に基づいて周辺物体を検出する周辺物体検出部と
を備える音検知装置。 - 前記周辺物体検出部は、前記2以上の集音部のうちの少なくとも2つにより集音された音信号間の位相差又は位相相関のうちの少なくともいずれかから求められる位相情報、の時間的な変動度合に基づいて周辺物体を検出する、請求項1に記載の音検知装置。
- 前記周辺物体検出部は、前記2以上の集音部のうちの少なくとも2つにより集音された前記音信号間の位相差と、該位相差における前記音信号間の位相相関との関係を示す位相分布の時間的な変動度合に基づいて前記周辺物体を検出する、請求項1又は2に記載の音検知装置。
- 前記周辺物体検出部は、前記2以上の集音部のうちの少なくとも2つにより集音された前記音信号間の位相相関のピークに対応する特定の位相差の時間的な変動度合に基づいて前記周辺物体を検出する、請求項1又は2に記載の音検知装置。
- 前記周辺物体検出部は、前記位相分布の変動度合が小さいほど、局所音源となる前記周辺物体が存在すると判定し易い、請求項3に記載の音検知装置。
- 前記周辺物体検出部は、前記位相分布の変動度合を示す指標が閾値以上である場合には、前記周辺物体が存在すると判定する、請求項5に記載の音検知装置。
- 前記位相分布の変動度合が小さいほど小さい閾値を設定する閾値設定部をさらに備え、
前記周辺物体検出部は、前記位相分布のピーク値が前記閾値以上である場合には、前記局所音源となる前記周辺物体が存在すると判定する、請求項3に記載の音検知装置。 - 前記位相分布の変動度合が小さく、前記位相分布のピークに対応する特定の位相差が大きいほど小さい閾値を設定する閾値設定部をさらに備え、
前記周辺物体検出部は、前記位相分布のピーク値が前記閾値以上である場合には、前記周辺物体が存在すると判定する、請求項3に記載の音検知装置。 - 前記周辺物体検出部は、前記位相分布のピークに対応する前記特定の位相差が大きいほど、前記周辺物体が存在すると判定し易い、請求項8に記載の音検知装置。
- 前記周辺物体検出部は、前記特定の位相差の変動度合が小さくなるほど、前記局所音源となる前記周辺物体がより接近していると判定し易い、請求項4に記載の音検知装置。
- 前記周辺物体検出部は、前記特定の位相差の変動度合が時間とともに小さくなる場合には、前記周辺物体が接近していると判定し易い、請求項10に記載の音検知装置。
- 前記周辺物体検出部は、前記特定の位相差の変動度合が大きくなるほど、前記局所音源となる前記周辺物体がより離脱していると判定し易い、請求項4に記載の音検知装置。
- 前記周辺物体検出部は、前記特定の位相差の変動度合が時間とともに大きくなる場合には、前記周辺物体が離脱していると判定し易い、請求項12に記載の音検知装置。
- 車両に搭載される、請求項1~13のいずれか一項に記載の音検知装置。
- 互いに離隔した2以上の位置で集音し、
前記2以上の位置のうちの少なくとも2つで集音された音信号の位相情報の時間的な変動度合に基づいて周辺物体を検出すること
を含む音検知方法。 - 互いに離隔して配置された2以上の集音部と、
前記2以上の集音部のうちの少なくとも2つにより集音された音信号の位相情報の時間的な変動度合に基づいて車両の運転支援を制御する運転支援制御部と
を備える運転支援装置。 - 前記運転支援制御部は、前記位相情報の変動度合が小さいほど前記運転支援を促進する、請求項16に記載の運転支援装置。
- 互いに離隔した2以上の位置で集音し、
前記2以上の位置のうちの少なくとも2つで集音された音信号の位相情報の時間的な変動度合に基づいて車両の運転支援を制御すること
を含む運転支援方法。 - 互いに離隔して配置された2以上の集音部と、
前記2以上の集音部のうちの少なくとも2つにより集音された音信号の位相情報の時間的な変動度合に基づいて車両の外部に対する報知を制御する報知制御部と
を備える報知装置。 - 互いに離隔した2以上の位置で集音し、
前記2以上の位置のうちの少なくとも2つで集音された音信号の位相情報の時間的な変動度合に基づいて車両の外部に対する報知を制御すること
を含む報知方法。
Priority Applications (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
EP12888813.8A EP2924673B1 (en) | 2012-11-22 | 2012-11-22 | Sound detection device and method, driving assistance device and method, as well as notification device and method |
PCT/JP2012/080384 WO2014080504A1 (ja) | 2012-11-22 | 2012-11-22 | 音検知装置及び方法、運転支援装置及び方法、並びに報知装置及び方法 |
JP2014548400A JP5954429B2 (ja) | 2012-11-22 | 2012-11-22 | 音検知装置及び方法、運転支援装置及び方法、並びに報知装置及び方法 |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
PCT/JP2012/080384 WO2014080504A1 (ja) | 2012-11-22 | 2012-11-22 | 音検知装置及び方法、運転支援装置及び方法、並びに報知装置及び方法 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2014080504A1 true WO2014080504A1 (ja) | 2014-05-30 |
Family
ID=50775709
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/JP2012/080384 WO2014080504A1 (ja) | 2012-11-22 | 2012-11-22 | 音検知装置及び方法、運転支援装置及び方法、並びに報知装置及び方法 |
Country Status (3)
Country | Link |
---|---|
EP (1) | EP2924673B1 (ja) |
JP (1) | JP5954429B2 (ja) |
WO (1) | WO2014080504A1 (ja) |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPWO2014102938A1 (ja) * | 2012-12-26 | 2017-01-12 | トヨタ自動車株式会社 | 音検知装置及び音検知方法 |
JP2018055371A (ja) * | 2016-09-28 | 2018-04-05 | アイシン精機株式会社 | 走行環境予測装置 |
Families Citing this family (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR102566412B1 (ko) | 2019-01-25 | 2023-08-14 | 삼성전자주식회사 | 음향 센서를 포함한 자동차 주행 제어 장치 및 그 방법 |
Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPH0592767U (ja) | 1992-05-18 | 1993-12-17 | 株式会社豊田中央研究所 | 接近車両認識装置 |
JP2007091028A (ja) * | 2005-09-28 | 2007-04-12 | Toyota Motor Corp | 車両用警報システム |
WO2011092813A1 (ja) * | 2010-01-28 | 2011-08-04 | トヨタ自動車株式会社 | 障害物検出装置 |
WO2012095939A1 (ja) * | 2011-01-12 | 2012-07-19 | パナソニック株式会社 | 車両台数特定装置及び車両台数特定方法 |
JP2012145461A (ja) * | 2011-01-12 | 2012-08-02 | Panasonic Corp | 車両方向特定装置及び車両方向特定方法 |
WO2012147187A1 (ja) * | 2011-04-27 | 2012-11-01 | トヨタ自動車株式会社 | 周辺車両検出装置 |
Family Cites Families (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2012146149A (ja) * | 2011-01-12 | 2012-08-02 | Panasonic Corp | 死角車両検知システム、死角車両検知装置、死角車両検知方法およびそのプログラム |
JP5516455B2 (ja) * | 2011-02-23 | 2014-06-11 | トヨタ自動車株式会社 | 接近車両検出装置及び接近車両検出方法 |
-
2012
- 2012-11-22 WO PCT/JP2012/080384 patent/WO2014080504A1/ja active Application Filing
- 2012-11-22 EP EP12888813.8A patent/EP2924673B1/en not_active Not-in-force
- 2012-11-22 JP JP2014548400A patent/JP5954429B2/ja not_active Expired - Fee Related
Patent Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPH0592767U (ja) | 1992-05-18 | 1993-12-17 | 株式会社豊田中央研究所 | 接近車両認識装置 |
JP2007091028A (ja) * | 2005-09-28 | 2007-04-12 | Toyota Motor Corp | 車両用警報システム |
WO2011092813A1 (ja) * | 2010-01-28 | 2011-08-04 | トヨタ自動車株式会社 | 障害物検出装置 |
WO2012095939A1 (ja) * | 2011-01-12 | 2012-07-19 | パナソニック株式会社 | 車両台数特定装置及び車両台数特定方法 |
JP2012145461A (ja) * | 2011-01-12 | 2012-08-02 | Panasonic Corp | 車両方向特定装置及び車両方向特定方法 |
WO2012147187A1 (ja) * | 2011-04-27 | 2012-11-01 | トヨタ自動車株式会社 | 周辺車両検出装置 |
Non-Patent Citations (1)
Title |
---|
See also references of EP2924673A4 * |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPWO2014102938A1 (ja) * | 2012-12-26 | 2017-01-12 | トヨタ自動車株式会社 | 音検知装置及び音検知方法 |
JP2018055371A (ja) * | 2016-09-28 | 2018-04-05 | アイシン精機株式会社 | 走行環境予測装置 |
Also Published As
Publication number | Publication date |
---|---|
JPWO2014080504A1 (ja) | 2017-01-05 |
EP2924673B1 (en) | 2017-03-15 |
JP5954429B2 (ja) | 2016-07-20 |
EP2924673A4 (en) | 2015-11-11 |
EP2924673A1 (en) | 2015-09-30 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
EP2758794B1 (en) | Sound source detecting system and sound source detecting method | |
EP2697664B1 (en) | Approaching vehicle detecting system and approaching vehicle detecting method | |
KR102033309B1 (ko) | 운전석 위치를 고려하는 빔 포밍 마이크 제어 장치 및 방법 | |
JP6146228B2 (ja) | 物体検知装置及び物体検知システム | |
CN108291966B (zh) | 物体检测装置以及物体检测方法 | |
MX2015014518A (es) | Funcionamiento del vehiculo basado en el rastreo de actividad. | |
EP2759843B1 (en) | Sound source detection device | |
EP3378706B1 (en) | Vehicular notification device and vehicular notification method | |
JP5954429B2 (ja) | 音検知装置及び方法、運転支援装置及び方法、並びに報知装置及び方法 | |
US20170059703A1 (en) | System for use in a vehicle | |
JP4912057B2 (ja) | 車両警報装置 | |
JPWO2014162538A1 (ja) | 検出装置及び運転支援装置 | |
JP2011252853A (ja) | 音源方向検出装置 | |
KR102325691B1 (ko) | 차량의 주행 경고 장치 및 방법 | |
JP2017022442A (ja) | 報知装置および報知方法 | |
JP2020154795A (ja) | 出力制御装置、出力制御方法、および出力制御プログラム | |
KR102324283B1 (ko) | 듀얼 마이크를 이용한 위상오류필터 기반의 음원 방향 검출 시스템 및 그 방법 | |
JP6272142B2 (ja) | 車載用音響装置 | |
KR20160066414A (ko) | 응급 상황 알림 시스템 | |
JP2014153927A (ja) | 運転支援装置及び運転支援方法 | |
JP2013068424A (ja) | 音源検出装置 | |
KR102288360B1 (ko) | 차량 센서 통합 장치 및 차량 센서 통합 방법 | |
WO2019049827A1 (ja) | 超音波出力装置、および発音制御方法 | |
JP2019104330A (ja) | 違和感判別方法及び違和感判別装置 | |
WO2014203308A1 (ja) | 運転支援装置 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 12888813 Country of ref document: EP Kind code of ref document: A1 |
|
ENP | Entry into the national phase |
Ref document number: 2014548400 Country of ref document: JP Kind code of ref document: A |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
REEP | Request for entry into the european phase |
Ref document number: 2012888813 Country of ref document: EP |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2012888813 Country of ref document: EP |