JP4725236B2 - Outside alarm sound notification device - Google Patents

Description

  The present invention relates to a vehicle outside warning sound notification device that is mounted on a vehicle such as an automobile and notifies a driver or the like of a warning sound emitted from an emergency vehicle or the like.

Various devices have been proposed that are mounted on vehicles such as automobiles and that detect sounds generated outside the vehicle and notify the driver.
Patent Document 1 describes an in-vehicle electronic device that analyzes the frequency of external sound collected by a microphone to determine the approach of an emergency vehicle and outputs approach information by voice. In the present invention, the approaching / leaving of the emergency vehicle is determined from the Doppler shift and the amplitude change of the outside sound.
Patent Document 2 discloses an in-vehicle emergency vehicle that calculates the distance / direction from the own vehicle to the emergency vehicle and the type of the emergency vehicle based on the siren sound detected from the captured outside sound, and notifies it with a screen display or synthesized voice. An announcement system is described.
Patent Document 3 describes an in-vehicle sound detection device that provides visual and tactile notification of the presence of an emergency vehicle when the acoustic characteristics of a vehicle exterior sound and the stored reference warning sound are similar. Yes.
Patent Document 4 describes a three-dimensional sound image presentation device and a three-dimensional sound image presentation method in which an alarm sound is localized at a position corresponding to a detection position of an approaching object to the host vehicle.
Japanese Patent Laid-Open No. 06-245289 JP 11-048886 A Japanese Patent Laid-Open No. 2002-166865 JP 2000-036998 A

In the above-described Patent Document 1, Patent Document 2, and Patent Document 3, the approach of an emergency vehicle is notified by a synthesized voice, a screen display, or a tactile sensation. Therefore, it is necessary to move the line of sight when viewing the screen or the like, which causes a problem in safe driving.
Moreover, although what was described in patent document 4 is a thing which localizes a warning sound, it does not alert | report using the warning sound based on an input sound, Moreover, relative speed with the emergency vehicle which generate | occur | produces a warning sound Etc. could not be clearly notified to the drivers.
Accordingly, the present invention provides an outside vehicle alarm sound notification device that can detect a warning sound or a sign sound approaching the host vehicle and clearly notify the driver without causing a problem in safe driving. It is an object.

In order to achieve the above object, a vehicle outside warning sound notification device according to the present invention includes a plurality of microphones that are attached to the periphery of a vehicle and collects sounds outside the vehicle, and an own vehicle among input signals from the plurality of microphones. Means for detecting the fundamental frequency of the sound approaching the vehicle, means for cutting out the fundamental waveform of the sound approaching the vehicle from the input signals from the plurality of microphones, and the fundamental frequency and basic waveform of the plurality of warning sounds Database storing information, fundamental frequency of sound approaching own vehicle detected by means for detecting fundamental frequency, basic waveform of sound approaching own vehicle cut out by means for cutting out basic waveform based on the bets, by referring to the database, to determine an alarm sound included in the input signal, a warning sound generation get information of the fundamental frequency and the basic waveform of the alarm sound that the determined A warning sound determining means for outputting, based on the input signals from the plurality of microphones, the direction detecting means for detecting the relative speed between the sound source and the vehicle with repeatedly detecting the position of the sound source emits a warning sound If, based on the information of the fundamental frequency and the fundamental waveform supplied from the alarm sound determining means generates a warning sound, a warning sound generating means for outputting the Doppler effect imparting means, which is generated by the warning sound generating hand stage Doppler effect imparting means for imparting a Doppler effect based on the direction detecting means relative speed of the information detected by the response to the warning sound, a warning sound of the Doppler effect has been imparted by the Doppler effect imparting hand stage, the It means for generating a multi-channel signal positioned in the detected sound source position by the direction detecting means, reproducing the multi-channel signal in the passenger compartment Those having a plurality of speakers that.
Furthermore, the Doppler effect imparting hand stage, to the generated warning sound, one that confers a significant frequency shift amount than the frequency shift amount based on the actual relative speed between the sound source and the vehicle of the warning sound is there.
In addition, there are sound approaching the subject vehicle in the input signal, when the information of the alarm sound corresponding to the sound approaches the the free-wheel in the database has not been recorded, the warning sound generating hand stage is to remove signal noise from the input signal, and supplies to the Doppler effect imparting hand stage as a warning sound.
Furthermore, the Doppler effect alarm sound that is granted when playing multi-channel, when the volume of the car audio is a predetermined value or more are those having a means for reducing the volume of it.

According to such a vehicle outside warning sound notification device of the present invention, since a warning sound corresponding to the detected warning sound is synthesized and output, a clean warning sound can be output. The sound picked up by the microphone often has a lot of noise components, and it is only annoying to amplify and output it, so search by database and synthesize sounds close to the results to amplify clean sounds It is not noisy because it outputs.
Further, by outputting a warning sound in multichannel, the presence of a vehicle located in the driver's blind spot, such as a motorcycle approaching the rear left side, can be clearly recognized by the driver, and danger prediction is possible.
In addition, it is possible to quickly determine from which direction an emergency vehicle such as an ambulance is approaching, and the determination is “Is it left to be avoided or right?”.

FIG. 1 is a block diagram showing the configuration of an embodiment of an outside warning sound notification device according to the present invention. FIG. 2 is a diagram illustrating a location where a microphone is mounted in a vehicle equipped with the outside warning sound notification device according to the present invention. It is a figure which shows an example of arrangement | positioning of a speaker.
In FIGS. 1 and 2, reference numerals 1a to 1h denote a plurality of microphones or sensors (hereinafter referred to as microphones) arranged in the periphery of the vehicle (body, roof, bumper, door, etc.) in order to pick up sounds outside the vehicle. ). In this embodiment, as shown in FIGS. 2A and 2B, eight microphones are provided in the front, rear, left and right peripheral portions of the vehicle. The number of microphones to be installed is not limited to eight, and may be any number that can detect the position of a sound source that emits an alarm sound or a sine sound, and may be three or more.
The outside sounds collected by the microphones 1a to 1h are amplified by head amplifiers (HA) 2a to 2h, respectively, and then converted into digital signals by corresponding A / D converters 3a to 3h.
The mixer unit (mixer) 4 adds the input signals from the microphones 1a to 1h converted into digital signals by the A / D converters 3a to 3h, performs noise removal, and performs a pitch detection unit (Pitch Detect). 5. Supply to the warning sound determination unit (Source Detect) 6 and the direction detection unit (Direction Detect) 8. The direction detection unit 8 is supplied with input signals from the microphones without being added.

The pitch detection unit 5 analyzes the signal from the mixer unit 4 using FFT (Fast Fourie Transform) analysis, general harmonic analysis, wavelet analysis, and the like, and compares it with the speed of its own vehicle. Detects the fundamental frequency of sound approaching your vehicle.
Similarly, the warning sound determination unit 6 performs analysis using FFT analysis, general harmonic analysis, wavelet analysis, and the like, and cuts out a basic waveform of a sound approaching the own vehicle. Based on the obtained basic waveform and the fundamental frequency detected by the pitch detector 5, a database search is performed from the warning sound database (Source Table) 7, and the corresponding warning sound or sine sound (patroller, ambulance, fire fighting) Car siren etc.). At this time, it is determined in consideration of the frequency shift due to the Doppler effect.

The warning sound database 7 is a warning sound database used for extracting and determining a warning sound by the warning sound determination unit 6, and information on the basic frequency and basic waveform of various warning sounds and sine sounds that may exist. Is a comprehensive database. In this warning sound database 7, for example, 750, 800, 850, 900, 1.00k, 1.06k, 1.12k, 1.18k, 1.25k, 1.32k, 1.40k, 1.50k, 1.60k, 1.70 are used as basic frequencies. k, 1.80k, 1.90k, 2.00k, 2.12k, 2.24k, 2.36k, 2.50k, 2.65k, 2.80k, 3.00k, 3.15k, 3.35k, 3.55k, 3.75k, 4.00k, 4.25k, Each frequency of 4.50k, 4.75k, 5.00k, 5.30k, 5.60k, 6.00k, 6.30k, 6.70k, 7.10k, 7.50k, 8.00k, 8.50k, 9.00k, 9.50k, 10.0k [Hz] Is stored. In addition, as basic waveforms, waveforms such as siren sounds such as ambulances, fire trucks, police cars, and white motorcycles, engine sounds such as motorcycles, trucks, and buses, running sounds, and horn sounds are stored.
When the warning sound is determined by the warning sound determination unit 6, the determined warning sound information (basic waveform and basic frequency information) is sent to the warning sound generation unit 9. Note that even if the corresponding warning sound information does not exist even if the warning sound database 7 is searched, the sound determined to be “approaching” is the sound from which noise has been removed by the mixer section 4 to generate a warning sound as it is. Sent to the department.

The direction detection unit 8 determines from which direction outside the vehicle the warning sound is transmitted based on the input signals from the plurality of microphones supplied from the mixer unit 4. That is, the position of the sound source emitting the warning sound is repeatedly detected at predetermined time intervals based on the level of the input signal from each of the microphones 1a to 1h and the input timing of the signal to each microphone. As a result, the relative speed between the sound source and the vehicle and the moving direction of the sound source can also be obtained.
The warning sound generation unit (Source Generator) 9 selects the data from the warning sound determination unit 6 and the signal from the mixer unit 4 to generate a warning sound to be output to the vehicle. That is, when data is supplied from the warning sound determination unit 6, a warning sound is generated based on the data, and the mixer unit is supplied when there is no warning sound information corresponding to the warning sound database 7. 4 is output to the Doppler effect applying unit 10 as a warning sound.

  The Doppler effect applying unit (Doppler Effect) 10 applies a Doppler effect to the warning sound signal sent from the warning sound generating unit 9 based on the data from the direction detecting unit 8 and outputs it. That is, the Doppler effect imparting unit 10 changes the pitch of the inputted warning sound based on the information on the relative speed with respect to the own vehicle output from the direction detecting unit 8. At this time, the Doppler effect is applied in a direction in which the Doppler effect is emphasized more than the actually audible pitch. Further, the degree of enhancement of the Doppler effect is controlled using engine speed data (Cycle) 11, vehicle speed data (Speed) 12, and data (Accelerator) 13 indicating the degree of depression of the accelerator supplied via the in-vehicle network. It is a parameter. For example, the degree of emphasis is increased during high speed operation than during low speed operation.

FIG. 3 is a diagram for explaining the Doppler effect imparted by the Doppler effect imparting unit 10.
In this figure, A indicated by a solid line shows an example of a pitch shift that normally appears due to the Doppler effect. When the sound source approaches, the pitch increases (frequency increases), and when the sound source moves away, the pitch decreases. (Frequency is low). Here, in the Doppler effect applying unit 10 of the present invention, as indicated by the broken line B, the pitch shift amount due to the Doppler effect is increased to give a more emphasized Doppler effect. That is, as shown in the figure, the shift amount of the pitch is made larger than the shift amount due to the actual speed, and the shift amount is obtained when the sound source approaches at a higher speed. For example, when the relative speed of implementation is 10 km / h, the pitch shift amount when the relative speed is 20 km / h is used.
Thus, by processing so that the relative speed and the relative distance become stronger, it becomes possible to notify the driver of the vehicle more clearly of the approach of the emergency vehicle or the like.

A matrix mixer unit (Matrix Mixer) 14 controls the level and timing of an input signal and outputs it to a plurality of output terminals. The warning sound to which the Doppler effect is applied by the Doppler effect applying unit 10 detects the direction. Control is performed so as to localize in the direction of the warning sound supplied from the unit 8, and surround output is performed in a multi-channel reproduction environment. That is, the warning sound to which the Doppler effect, which is an audio signal output from the Doppler effect applying unit 10, is converted into a 5.1 channel output by the matrix mixer unit 14, and the warning sound detected by the direction detecting unit 8 is converted. A sound distribution amount is determined so that the sound can be heard from the direction of the sound source, and surround output is performed from a plurality of speakers provided in the passenger compartment.
At this time, if necessary, the volume of the car audio or the like is automatically suppressed, and automatic volume adjustment is performed so that the processed warning sound can be heard loudly. For example, when the car stereo is operating and the volume is equal to or higher than a predetermined value, the volume is reduced and the volume is adjusted so that the warning sound with the Doppler effect can be heard loudly.

In this embodiment, six speakers 17a to 17f are installed in the vehicle interior, and six-channel signals corresponding to the respective speakers are output from the matrix mixer section 14, and the corresponding D / As are respectively provided. The analog signals are converted by the converters 15a to 15f, amplified by the power amplifiers 16a to 16f, and output from the speakers 17a to 17f.
(C) of FIG. 2 is a figure which shows an example of arrangement | positioning in the vehicle interior of the said speakers 17a-17f. As shown in this figure, a plurality (six in this example) of speakers are arranged in the vehicle interior so that surround reproduction can be performed. Thereby, it is possible to clearly recognize in which direction the sound source of the warning sound or sine sound is located not only on the left and right but also on the front and back. The number of speakers is not limited to six as long as the sound can be surround.

It is a block diagram which shows the structure of one Embodiment of the vehicle outside warning sound alerting | reporting apparatus of this invention. It is a figure which shows an example of the attachment position of the microphone in the vehicle by which the alarm outside alarm device of this invention is mounted, and the arrangement | positioning of the speaker in a vehicle interior. FIG. 3 is a diagram for explaining the amount of the Doppler effect applied by the Doppler effect applying unit 10.

Explanation of symbols

  1a to 1h: microphone, 2a to 2h: head amplifier, 3a to 3h: A / D converter, 4: mixer unit, 5: pitch detection unit, 6: warning sound determination unit, 7: warning sound database, 8: direction Detection unit, 9: warning sound generation unit, 10: Doppler effect application unit, 11: engine speed data, 12: vehicle speed data, 13: data indicating degree of depression of accelerator, 14: matrix mixer unit, 15a to 15f: D / A converter, 16a to 16f: power amplifier, 17a to 17f: speaker

Claims (4)

A plurality of microphones that are attached to the periphery of the vehicle and collect sound outside the vehicle;
Means for detecting a fundamental frequency of a sound approaching the vehicle among input signals from the plurality of microphones ;
Means for cutting out a basic waveform of a sound approaching the vehicle from input signals from the plurality of microphones;
A database that stores information on the basic frequency and basic waveform of multiple warning sounds;
Based on the fundamental frequency of the sound approaching the own vehicle detected by the means for detecting the fundamental frequency and the basic waveform of the sound approaching the own vehicle cut out by the means for cutting out the basic waveform, the database The warning sound determining means for determining the warning sound included in the input signal and outputting the determined basic frequency and basic waveform information to the warning sound generating means ,
Based on input signals from the plurality of microphones, direction detection means for repeatedly detecting the position of a sound source emitting a warning sound and detecting the relative speed between the sound source and the vehicle ;
A warning sound generating means for generating a warning sound based on the basic frequency and basic waveform information supplied from the warning sound determining means, and outputting the warning sound to the Doppler effect applying means ;
Doppler effect imparting means for imparting a Doppler effect based on the relative velocity of the information detected by said direction detecting means on the generated warning sound by the warning sound generating hand stage,
It means for generating a multi-channel signal positioned a warning sound the Doppler effect has been imparted by the Doppler effect imparting hand stage, the detected sound source position by the direction detecting means,
A vehicle outside warning sound notification device comprising: a plurality of speakers for reproducing the multi-channel signal in the vehicle interior. Said Doppler effect imparting hand stage, to the generated warning sound is one that confers a significant frequency shift amount than the frequency shift amount based on the actual relative speed between the sound source and the vehicle of the warning sound The vehicle outside warning sound notification device according to claim 1. Sound approaching the vehicle is present in the input signal, when the information of the alarm sound corresponding to the sound approaches the the free-wheel in the database has not been recorded, the warning sound generating hand stage, the exterior alarm sound informing device according to the input signal a signal obtained by removing noise, to claim 1 or 2, characterized in that said and supplies the Doppler effect imparting hand stage as a warning sound. When multi-channel playback a warning sound granted the Doppler effect, any claim 1-3, characterized in that it comprises a means for reducing the volume of that when the volume of the car audio is not less than a predetermined value A vehicle outside warning sound notification device.

Images