JPH06245289A - On-vehicle electronic device - Google Patents

Abstract

PURPOSE:To execute proper processing such as notice to the driver of a vehicle by using a microphone to detect a sound generated at both inside and outside of the vehicle so as to detect the sound on the outside of the vehicle with respect to the on-vehicle electronic device such as a cellular telephone system or an on-vehicle voice recognition device. CONSTITUTION:The on-vehicle electronic device mounted on a vehicle, having a microphone 1 to catch a sound in the inside of the vehicle, and performing processing of an electric signal transduced by the microphone 1 is provided with a frequency component analysis section 51 catching a sound generated on the outside of the vehicle by the microphone 1 and analyzing a frequency of the transduced electric signal, a discrimination selection section 53 judging approach of an emergency automobile such as an ambulance or a patrol car based on the result of the frequency analysis and outputting with the approach information converted to a sound, and a notice information storage section 52 storing voice information data to inform access of an emergent automobile.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an on-vehicle electronic device such as an automobile telephone and an on-vehicle voice recognition device. In particular, the present invention uses a microphone for detecting a sound generated inside or outside a vehicle to detect a sound outside the vehicle. Detecting and performing appropriate processing such as notifying the driver.

[0002]

2. Description of the Related Art Conventionally, vehicle-mounted electronic devices as technologies in such fields include a car telephone and a vehicle-mounted voice recognition device. A car phone is provided to exchange information with the outside of the car. In-vehicle voice recognition devices try to control the equipment inside the vehicle by voice without using the hands and feet of the driver. On the other hand, there is an emergency vehicle in which an emergency signal is wirelessly transmitted by a radio oscillator at the same time as the sairay to notify the driver via the vehicle radio.

[0003]

By the way, in the conventional vehicle-mounted electronic device, when the operating rate is low, there is a problem that this should be effectively utilized. On the other hand, in recent years, the sound insulation performance of vehicle exterior sound has been improved in a way that meets the needs of quieting the inside of the vehicle. Along with this, there is a problem that it is difficult to detect sound information that needs to be promptly detected and dealt with, such as an emergency vehicle. In addition, it is difficult to immediately judge whether the driver's vehicle is able to capture the sound, whether it is approaching or leaving (away), and from which direction it is approaching. There's a problem. For this reason,
At an intersection, etc., because the road cannot be changed to an emergency vehicle, not only is there a fear of an accident or the like accompanying the traveling of the emergency vehicle, but also the traveling of the emergency vehicle is disturbed.
As mentioned above, in the case of wireless communication, a wireless device must be installed on the side of the emergency vehicle, and because it is wireless, the direction in which the emergency vehicle is traveling cannot be known, and even unrelated vehicles are notified, causing confusion. There is.

Therefore, in view of the former problem and the latter problem, the present invention detects the sound outside the vehicle, notifies the driver of the approach information, and improves the utilization efficiency without requiring any measures for the emergency vehicle. The purpose is to provide a device.

[0005]

In order to solve the above-mentioned problems, the present invention has a microphone mounted on a vehicle for capturing sound in a vehicle compartment and processing an electric signal converted by the microphone. A frequency component analysis unit, a judgment selection unit, and a notification information storage unit are provided in the electronic device for use.

The frequency component analyzing section captures a sound generated outside the vehicle compartment by the microphone and frequency-analyzes the converted electric signal. Based on the result of the frequency analysis, the judgment selection unit judges the approach of an emergency vehicle such as an ambulance or police car and outputs the approach information as a voice. The notification information storage unit stores audio information data for notifying the approach of the emergency vehicle.

The judgment and selection section judges whether to approach or leave based on the Doppler shift and the change in amplitude. further,
A plurality of microphones are provided in the vehicle compartment, and the judgment selecting unit judges the approaching direction of the emergency vehicle from the amplitude and time difference of the output signals of the microphones.

The determination / selection unit is adapted to calculate the speed of the emergency vehicle using the Doppler shift amount of the reference frequency and the vehicle speed data of the own vehicle. The frequency component analysis unit determines the type of the emergency vehicle and sets the width of the frequency band for extracting the frequency peak in consideration of the range of the Doppler shift with the emergency vehicle.

In order to detect the sound outside the passenger compartment, at least a car telephone and a microphone used in a voice recognition device are used. The determination and selection unit drives the wiper by determining the sound of rain or snow. 2. The vehicle-mounted electronic device according to claim 1, wherein the sound generated in the vehicle interior, which is included in the microphone, is canceled by a signal from a separately installed microphone or an audio device provided separately from the microphone in the vehicle interior.

[0010]

According to the on-vehicle electronic device of the present invention, a sound generated outside the vehicle compartment is captured by the microphone, the converted electric signal is subjected to frequency analysis, and based on the result of the frequency analysis, such as an ambulance or a police car. The approach of the emergency vehicle is judged and the approach information is output as a voice. In this case, by storing the voice information data for notifying the approach of the emergency vehicle, the siren of the emergency vehicle against the sound insulation of the exterior sound is stored. To prevent accidents and prevent roadblocks. Doppler shift as specific approach information, approach and departure is determined from the change in amplitude, further provided with a plurality of microphones in the vehicle compartment, the approach direction of the emergency vehicle is determined from the amplitude and time difference of the output signals of these microphones, The speed of the emergency vehicle is calculated using the Doppler shift amount of the reference frequency and the vehicle speed data of the own vehicle. Reliability is improved by setting the width of the frequency band for identifying the type of the emergency vehicle and extracting the frequency peak in consideration of the range of the Doppler shift with the emergency vehicle. At least a car phone and a microphone used in a voice recognition device are used to detect the sound outside the vehicle compartment, so that the existing equipment can be effectively used. Furthermore, the safety is improved by driving the wiper by judging the sound of rain or snow. Further, by canceling the sound generated in the vehicle compartment included in the microphone by the signal of the separately installed microphone or the audio device provided separately from the microphone in the vehicle compartment, malfunction can be prevented.

[0011]

Embodiments of the present invention will be described below with reference to the drawings. FIG. 1 is a diagram showing an example of an in-vehicle electronic device according to an embodiment of the present invention, which detects an approach of an emergency vehicle and informs a driver whether or not the vehicle is approaching. The vehicle-mounted electronic device shown in the figure is connected to a microphone 1 for detecting a sound outside the vehicle, a low-pass filter 2 for removing unnecessary components of an electric signal converted by the microphone 1, and a low-pass filter 2. Amplifier 3 that amplifies its output
And an A / D converter 4 (Analog to Digital Conv) connected to the amplifier 3 and converting an analog signal into a digital signal.
erter) and a notice information processing unit 5 for processing information for notifying the approach of an emergency vehicle by storing the digital signal connected to the A / D converter 4 for a certain period of time, and the notice information processing unit 5 Is connected to the D / A converter 6 (Digit) for converting the digital signal resulting from the processing to an analog signal.
al to Analog Converter) and a low-pass filter 7 for removing unnecessary components included in the output signal of the D / A converter 6.
A power amplifier 8 connected to the low-pass filter 7 to amplify the power of the output signal, and a speaker 9 driven by the power amplifier 8. The microphone 1 may be positively placed separately, but in the case of a car telephone, a hand-free one can be easily installed as a pillar-mounted one for detecting in-vehicle sound, and in the case of a voice recognition device, it can be driven. It is possible to easily use a plurality of voices that are used for accurately capturing the voice of a person or capturing the voices of passengers in the passenger seat and the rear seat. In many voice recognition devices, a microphone can be attached to the pillar. The microphone installed in the pillar is suitable for detecting outside sound. If the microphone can also be used in this way, it can contribute to the reduction of the cost of the sensor.

Next, the notification information processing section 5 will be described in detail. The notification information processing unit 5 is a DSP (Digital Signal Pro).
a frequency component including a band pass filter and FFT (Fast Fourier Transformation) in order to analyze the frequency components contained in the sound detected by the microphone 1 by inputting the digital signal from the A / D converter 4 Required from the component analysis unit 51, the notification information storage unit 52 that stores information to be notified to the driving vehicle, and the notification information stored in the notification information storage unit 52 based on the result of the frequency analysis of the frequency component analysis unit 51. Based on the judgment from the judgment selecting unit 53, the judgment selecting unit 53 makes a judgment to select, and the necessary notification information is obtained from the notification information storage unit 52, synthesized into a voice, and output to the D / A converter 6. A voice synthesizer 54 is provided.

The details of the judgment selecting section 53 will be described.
FIG. 2 is a diagram showing the configuration of the judgment selection unit 53. As shown in the figure, the determination and selection unit 53 stores a frequency analysis result from the frequency component analysis unit 51 for a fixed time required for subsequent processing, and a storage unit 531 for storing an emergency vehicle based on the data of the storage unit. An ambulance / patrol car distinguishing unit 532 for distinguishing an ambulance from a police car, an approach determining unit 533 for determining an approach of an emergency vehicle based on the data of the storage unit, and an approach for determining an approach direction of the emergency vehicle based on the data of the storage unit. A direction determination unit 534, an approach speed calculation unit 535 that obtains an approach speed of an emergency vehicle based on the data of the storage unit, and a wiper or the like for determining the determination of rainfall, snowfall, or the like based on the data of the storage unit. The rainfall determination unit 536, the ambulance / patrol car discrimination unit 532, the approach determination unit 533, the approach direction determination unit 534, the approach speed calculation unit 535, and the rainfall determination unit 536. By combining the notification information from the notification information storage unit 52 based on the force to form the announcement contents comprise a notification contents forming unit 537 parts to be output to the speech synthesis unit 54.

FIG. 3 is a diagram showing an example of the analysis result of the frequency section 51 of FIG. Emergency vehicles include ambulances and police cars. This figure (a) shows the result of the frequency analysis of the ambulance siren. As shown in the figure, in the case of an ambulance, the frequencies f1 and f2 with "Peep Pop" are alternately repeated. When the frequency component analysis unit 51 is a band filter, the center frequencies f1 and f2 have a constant width as shown in FIG. This figure (b) shows the result of frequency analysis of the police car siren. As shown in this figure, in the case of a police car, the frequency is between f3 and f4 and the amplitude continuously and periodically changes. When the frequency component analysis unit 51 is a band filter, a plurality of band filters are provided between them, and a certain width is provided for each to extract a frequency peak. F in the frequency component analysis unit 51
A method of setting the frequency band when using FT will be described.

FIG. 4 is a diagram for explaining an example for performing the window function processing on the FFT analysis result in the frequency component analysis unit 531 of FIG. 1 and storing it in the storage unit 531. FF as bandwidth
The window function for the result of T considers the range in which the frequency fluctuates due to the Doppler effect due to the relative speed between the own vehicle and the emergency vehicle. As an example, the own vehicle and the emergency vehicle are each 1 hour
Assuming that the body surface travels at 00 km / h (28 m / s), the body surface approaching speed is 56 m / s, so the sound velocity is 340
If the frequency is m / s, the frequency shift is (340 + 56) m / 3
40m = 1.16. If the speed of the host vehicle is 0 km / h and the emergency vehicle is traveling at a speed of 100 km / h (28 m / s) to leave (separate), the speed of leaving is 28 m / s, so the speed of sound is 340 m. / S, the frequency shift is (340-28) m / 340m =
It is 0.92. As shown in the figure, in the frequency analysis by the FFT of the frequency component analysis unit 51, it is assumed that the emergency car is a police car, and F1, F2, and F3 are extracted as an example of frequencies to be detected between frequencies f3 and f4. In this case, the window function a of each frequency,
b1 and c2 are F1 · 0.92 to F1 · 1.16,
F2 / 0.92-F2 / 1.16, F3 / 0.92-F
It should be 3.1.16. Then, the respective threshold values are set to a, b, and c. In the frequency component analysis unit 51, F
Multiply the window function to the data analyzed by FT,
Thresholding processing is performed to make those below the threshold value zero, and the result is stored in the storage unit 531 as frequency and amplitude information. This frequency information is shifted from the reference frequencies F1, F2, F3 by the correction coefficient C1 (= (F1'-F1) / F1, F1 ': analysis frequency, the same applies hereinafter), C2, C3. In the storage unit 1, for example, with respect to the reference frequency F1 and its amplitude, C1 · F1, 3; C1 · F1, 2.8, ...
It is stored like. In addition, ambulance frequencies f1 and f
Similarly for 2, the bandwidth can be defined by the window function. Further, the bandwidth of the bandpass filter can be set within the range determined by the window function.

FIG. 5 shows the ambulance / patrol car discrimination unit 53 of FIG.
It is a figure explaining the distinction of the emergency vehicle by 2. This (a) shows the ambulance identification based on the frequency analysis results.
In frequency analysis, there are variations within a certain range,
The frequency f1 is maintained from time T1, T2, ... To Tk, the frequency f2 is maintained from time Tl, Tl + 1 to Tm, and the frequency f1 is maintained from Tn, Tn + 1 ,. It is judged that the siren is an ambulance due to repeated changes in frequency such as. This (b) shows the identification of police cars based on the frequency analysis results. In frequency analysis, there are variations within a certain range, but at times T1 and T
2, ..., Tk, and frequency F1, F2, ..., Fn, and from time Tl, Tl + 1 to Tm, frequency F
, Fn, and frequencies T1, Tn + 1, ..., To to frequencies F1, F2, ..., Fn. From such frequency change, it is determined that the siren is a siren from a police car.

FIG. 6 is a diagram for explaining the determination of whether or not the emergency vehicle is approaching by the approach determination unit 533 of FIG. As shown in this figure (a), for example, in the case of an ambulance, one of the two frequencies, and in the case of a police car, the maximum frequency or the minimum frequency, the frequency analysis at a certain time The amplitude is A1. As shown in this figure (b), when an emergency vehicle approaches, the frequency analysis result shows that the frequency increases due to the Doppler effect and changes from f1 to fa (> f1), and at the same time the amplitude also increases.
It changes from 1 to A3 (> A1). From this change, the judgment selection unit 53 judges that the emergency vehicle is approaching. On the contrary, as shown in this figure (c), when the emergency vehicle leaves (leaves), the frequency analysis result shows that the frequency decreases due to the Doppler effect and f1 changes to fb (<fb), and at the same time the amplitude also decreases and from A1. It changes to A2 (<A1). Based on this change, the judgment selection unit 53 judges that the emergency vehicle is away.

FIG. 7 is a diagram for explaining the data processing of the approaching direction judging section 534 of FIG. As shown in this figure (a), the microphones 1-1 and 1 are installed in the vehicle on the left and right with respect to the traveling direction.
-2 is provided, and the approach direction determination unit 534 uses these microphones 1-1 and 1-2 as shown in FIG.
The signal data is input, and the approach direction is obtained by comparing the amplitudes of the signal data. Microphone 1-1
If the signal amplitudes of 1-2 are a and b, and if a> b, it is determined that the approach is from the right, and if a <b, it is determined that the approach is from the left. Alternatively, the approach direction may be determined by analyzing the arrival time difference between the two. In this way, the approaching direction of the emergency vehicle can be roughly estimated. If a microphone is attached to the inside of the vehicle compartment, the approaching directions of the emergency vehicle from the front and the rear can be similarly determined.

Next, the approaching speed calculating section 535 is for estimating the approaching speed of the emergency vehicle and judging the danger.
For example, using the example of FIG. 4, when the reference frequency of the maximum frequency of the police car is F1 and the frequency obtained by the analysis is C1 · F1, the relative speed V is V = (C1-
1) V0, (V0: speed of sound 340 m), it is determined that V> 0 is approaching and V <0 is leaving, but especially when approaching, it is a dangerous state. This is because it is not known if they are approaching at the speed of. Therefore, when it is determined that the vehicle is approaching, the speed of the host vehicle is usually slowed down. Therefore, if the relative speed is increased in that case, it can be known that the emergency vehicle is approaching from behind. In this case, the speed of the emergency vehicle is obtained by subtracting the speed of the own vehicle from the relative speed. The speed of the host vehicle can be used by processing the signal from the vehicle speed sensor. On the contrary, if the relative speed decreases when the speed of the host vehicle slows down, the emergency vehicle approaches from the facing direction. Therefore, the speed of the emergency vehicle is obtained by adding the speed of the host vehicle to the relative speed. Note that the approach speed may be obtained using the approach direction information of the approach direction determination unit 534.

Next, the rainfall etc. determination unit 536 stores in advance the sound information (pattern) of the rainfall and snowfall and compares it with the detected sound information (pattern) to determine the rainfall, snowfall, etc. Based on this determination, the wiper motor 11 is driven via the accessory control 10. The reference sound information such as rainfall may be obtained by learning to store sound information (pattern) when the driver drives the wiper. As described above, since the microphone or the like in the vehicle is used as a sensor, the number of failures is reduced, and the operation by the limbs of the driving vehicle is reduced, which contributes to safe driving.

The notification content forming section 537 will be described.
The notification information storage unit 52 stores, for example, 1. "Emergency car is approaching", 2.
As a pattern b such as "emergency car is running", 1.
"Emergency car", 2. "Ambulance", 3. "A police car", 4. "From the left", 5. "From the right", 6. "From the front", 7. "From behind", 8. "At high speed", 9.
"Slowly", 10. "From afar", 11. "Nearby", 12. "I'm approaching", 13. "Running",
14. "It's raining," 15. "It is snowing" etc. are memorized. The notification content forming unit 537, based on the information of the ambulance / patrol car distinguishing unit 532 and the like, the notification information storage unit 5
An appropriate notification content is selected from 2 and output to the voice synthesis unit 54. For example, "ambulance is""from the right""at a fast speed"
Can be combined with "approach". Also,
In a simple manner, a warning sound of only a buzzer may be generated when approaching.

FIG. 8 is a diagram for explaining a microphone or the like that cancels the sound generated in the vehicle compartment and extracts only the sound outside the vehicle. A microphone 1-100 having directivity for collecting a vehicle interior sound is separately provided for the microphone 1-1, and a delay 200 for adjusting the timing of the output signal of the microphone 1-100 and an amplitude of the output signal are adjusted. Amplitude adjusting section 201, and the amplitude adjusting section 201
An adder 202 for adding the inverted signal of 1 to the output signal of the microphone 1-1 and outputting to the low-pass filter 2 is provided to cancel the vehicle interior sound included in the microphone 1-100. The microphone 1-100
Alternatively, a signal from an audio device may be used.

[0023]

As described above, according to the present invention, the approach information of an emergency vehicle such as an ambulance or a police car is judged based on the result of the frequency analysis and the approach information is output as a sound. Against emergency car accident prevention,
Prevent running obstacles. The existing equipment can be effectively used because the car phone and the microphone of the voice recognition device can be used to detect the sound outside the vehicle. Further, the windshield wiper can be driven by judging the sound of rain or snow, which improves safety. The sound generated in the passenger compartment, which is included in the input signal of the microphone, is canceled, and malfunction can be prevented.

[Brief description of drawings]

FIG. 1 is a diagram showing an example of an in-vehicle electronic device according to an embodiment of the present invention, which detects an approach of an emergency vehicle and informs a driver whether or not the vehicle is approaching.

FIG. 2 is a diagram showing calibration of a judgment selection unit 53 in FIG.

FIG. 3 is a diagram showing an example of an analysis result of a frequency analysis unit 51 of FIG.

FIG. 4 is a diagram showing an example for performing a window function process on an FFT analysis result by a frequency component analysis unit 515 of FIG. 1 and storing the result in a storage unit 531.

FIG. 5 is a diagram for explaining discrimination between emergency vehicles by an ambulance / patrol car discrimination unit 532 in FIG.

FIG. 6 is a diagram illustrating a determination by an approach determination unit 533 of FIG. 2 whether or not an emergency vehicle is approaching.

7 is a diagram illustrating data processing of an approaching direction determination unit 534 of FIG.

FIG. 8 is a diagram illustrating a microphone or the like that cancels the sound generated in the vehicle compartment and extracts only the sound outside the vehicle.

[Explanation of symbols]

 1, 1-1, 1-2, 1-100 ... Microphone 4 ... A / D converter 5 ... Notification information processing unit 5 6 ... D / A converter 9 ... Speaker 51 ... Frequency component analysis unit 52 ... Notification information storage Part 53 ... Judgment selection part 54 ... Speech synthesis part

Claims (8)

[Claims] 1. A microphone (1) mounted on a vehicle, for capturing sound in a vehicle compartment, the microphone (1).
A vehicle-mounted electronic device for processing the electric signal converted by the method, comprising: a frequency component analysis unit (51) for capturing a sound generated outside the vehicle by the microphone (1) and performing a frequency analysis on the converted electric signal. A judgment selection unit (53) for judging the approach of an emergency vehicle such as an ambulance or a police car and outputting the approach information as a sound based on the result of the frequency analysis; and for notifying the approach of the emergency vehicle. An on-vehicle electronic device comprising a notification information storage section (52) for storing voice information data. 2. The on-vehicle electronic device according to claim 1, wherein the judgment selection unit (53) judges whether the emergency vehicle is approaching or leaving based on Doppler shift and amplitude change. 3. A plurality of microphones (1-
2. The method according to claim 1, wherein the determination selecting unit (53) determines the approach direction of the emergency vehicle from the amplitude and time difference of the output signals of the microphones (1-1, 1-2). In-vehicle electronic device. 4. The vehicle-mounted electronic device according to claim 1, wherein the judgment selection unit (53) calculates the speed of the emergency vehicle using the Doppler shift amount of the reference frequency and the vehicle speed data of the own vehicle. 5. A width of a frequency band in which the type of an emergency vehicle is discriminated by the frequency component analysis unit (51) and a frequency peak is extracted is set in consideration of a range of Doppler shift with the emergency vehicle. 1. The vehicle-mounted electronic device according to 1. 6. The in-vehicle electronic device according to claim 1, wherein at least a microphone used in a car telephone or a voice recognition device is used to detect a sound outside the vehicle compartment. 7. The vehicle-mounted electronic device according to claim 1, wherein the determination selection unit (53) drives the wiper by determining the sound of rain or snow. 8. The sound generated in the vehicle compartment included in the microphone (1) is canceled by a signal of a microphone (1-100) provided separately from the microphone (1) in the vehicle compartment or an audio device. The on-vehicle electronic device described.