JPH07159190A - Sound device totallizing system on vehicle - Google Patents

Abstract

PURPOSE:To provide a sound device totallizing system on a vehicle with which sound information in the vehicle can be totally controlled to be transmitted in such a mode that a person on the vehicle can recognize the information in accordance with situation easily. CONSTITUTION:A voice synthesizing device 6 outputs sound image normal position information S62 included in information from each system, and a voice output noticing signal S63 to indicate that a voice signal S61 is outputted from the voice synthesizing device 6 to a sound image normal position control device 7 while the voice signal S61 selected from among outputs of system 1 to 3 is outputted to the sound image normal position control device 7. The sound image normal position control device 7 selects the voice signal S61 in the case where a voice output noticing signal S63 is detected, and it selects and outputs a voice source S4 from an audio system 4 in the case where the signal S63 is not detected. A speaker 9 electroacoustic-transduces the inputted signal from a low frequency amplifier 8 to generate voice to a person inside a vehicle 10.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an in-vehicle audio device integrated system, and more particularly to an in-vehicle audio device integrated system for transmitting route guidance information of a vehicle and information for supporting safe driving by using voice. .

[0002]

2. Description of the Related Art Conventionally, various kinds of information have been often transmitted to passengers of an automobile by using voice (or sound). This is because, like car audio, information may be originally transmitted by voice, and it is excellent to use voice as a man-machine interface in a car.

For example, if an image is used for transmitting information, the driver must move his or her line of sight from the front and gaze at the image in order to obtain the information, which increases fatigue in driving. On the other hand, if the voice is used for the information transmission, the driver can obtain the information while driving, so that the driver can transmit the information without fatigue.

Due to these advantages, many of the information devices brought into the automobile output voice. Most of these information devices output sound from a single speaker, and even when using a plurality of speakers, a sound image is localized and output at a preset position.

[0005]

However, in the case where a plurality of information devices for outputting sound are provided in a vehicle, it is not preferable for passengers such as drivers to output sound information independently of each other. There is a problem that occurs. For example, when voices are simultaneously produced from a plurality of information devices, it becomes difficult for a passenger to recognize one piece of information, and thus it may be difficult to recognize the other information. In this case, there is a possibility that no information can be recognized.

In addition, even if a single speaker with a fixed audio output or a plurality of speakers is used,
If the sound image is localized at a preset position, from the perspective of the passenger, it may be heard from the left side even though it is originally information on the right side. There is also the problem of inviting.

Further, for passengers of a vehicle, there is information about necessary sounds, such as a siren of an emergency vehicle, an alarm sound of a circuit breaker, and a horn of an automobile, in the sound outside the vehicle.
However, in order to enhance the comfort of the inside of the vehicle, the sound outside the vehicle is not easily transmitted to the inside of the vehicle, or when the noise is dynamically turned off, or when it is drowned out by other sounds inside the vehicle. However, there is a problem that the information on the sound outside the vehicle cannot be fully recognized.

The present invention has been made in view of the above points, and it is possible to integrally manage sound information in an automobile and to transmit information according to the situation in a form that a passenger can easily recognize. It is an object of the present invention to provide an in-vehicle audio device integrated system.

[0009]

In order to achieve the above object, the present invention provides a plurality of information output systems for outputting information transmitted by voice to an occupant of a vehicle together with sound image localization position information, and installed in the interior of the vehicle. Selected one or more acoustic output devices and one of the information transmitted from the plurality of information output systems by voice, convert the information into a voice signal, and convert the voice signal into the sound image localization position information. The sound image control means outputs the sound image to the sound output device so that the sound image localization according to the above can be obtained.

The plurality of information output systems are devices that output at least a pair of character information that is transmitted to the driver by voice and sound image localization position information that localizes the sound image.
Further, the sound image control means sequentially selects each piece of information from the plurality of information output systems and outputs a synthesized speech signal based on the selected character information, and a synthesized speech signal from the speech synthesis apparatus. , A sound image localization control device that performs a sound image localization process based on the sound image localization position information that forms a pair of a synthetic voice signal and outputs the sound image localization process to the acoustic output device.

[0011]

According to the present invention, the information about the direction that the driver wants to recognize, such as the direction in which the vehicle is guided from each of the plurality of information output systems and the direction in which there is a building that serves as a mark, the direction in which danger is predicted, and the emergency vehicle. Such as the approaching direction,
Even if information about the direction in which the driver should pay attention is output at the same time, the sound image synthesizer that constitutes the sound image control means selects one by one from the most necessary information in that situation, and converts it into an audio signal. Then, the sound can be output to the sound output device.

Further, in the present invention, the sound image localization control device constituting the sound image control means outputs the audio signal having the content of the selected information so as to localize the sound image at the position indicated by the sound image localization position information. Therefore, the sound image can be localized at the optimum position of the selected information.

Further, according to the present invention, the sound image localization control device performs sound image localization processing on at least a sound source from the audio system based on the sound image localization position information when the synthesized voice signal is not input from the voice synthesis device. , Can be output to the sound output device.

[0014]

EXAMPLES Next, examples of the present invention will be described.
FIG. 1 shows a block diagram of a first embodiment of the present invention. The in-vehicle audio device integrated system according to the present embodiment includes a navigation system 1, a safe driving support system 2, a warning sound recognition system 3, an audio system 4, a voice synthesis device 6, a sound image localization control device 7 that controls a localization position of a sound image, It has a low-frequency amplifier 8 and a plurality of speakers 9 installed inside the automobile 10.

The navigation system 1 outputs the vehicle position information calculated based on the measured values of various sensors and the information S1 necessary for the route guidance to the destination set by the passenger.

FIG. 2 shows an example of the data format of the information S1 sent from the navigation system 1. In the figure, a is the name of the output system, b is character information that the driver wants to convey, such as "Turn to an intersection," and c is sound image localization position information, such as "45 degrees to the right" and "0 degrees above." Indicates.

Referring again to FIG. In order to support the safe driving of the own vehicle, the safe driving support system 2 detects, for example, the danger that a child has jumped out on the road or is about to collide with an oncoming vehicle, and provides information S2 that calls the driver's attention. Output. In addition to alerting the driver, danger may be avoided by more actively controlling the control system, such as applying a brake.

The warning sound recognition system 3 analyzes the sound outside the vehicle, and if it contains warning sounds such as a siren of an emergency vehicle or an alarm sound of a railroad crossing, the information for calling the driver's attention. Outputs S3. The output information S2 of the safe driving support system 2 and the warning sound recognition system 3
Similarly to the output information of the navigation system 1 shown in FIG. 2, the output information S3 of No. 3 includes an output system name, character information to be transmitted to the driver, and sound image localization position information.

The audio system 4 is composed of a voice reproducing device such as a radio, a cassette tape recorder, a compact disc, and a television, and a device such as a volume, an equalizer, and a balancer for adjusting the amplitude and waveform of the voice, and outputs a voice source S4.

The voice synthesizer 6 uses the information S1 from the navigation system 1, the information S2 from the safe driving support system 2 or the information S from the warning sound recognition system 3.
Voice signal S6 created based on the character information included in 3
1 is output. At this time, when a plurality of pieces of information are input to the voice synthesizer 6 at the same time, the information from the information source having a high priority is selected and the voice signal S61 is output.
However, when the passenger sets to output only the information from the specific information source through the input device, the voice synthesizer 6 uses only the character information in the information from the corresponding specific information source. The created audio signal S61 is output.

Further, the voice synthesizer 6 is configured to output the voice signal S6.
While outputting 1 to the sound image localization control device 7, at the same time, the sound image localization position information S62 included in the information from each system.
And a voice output notification signal S63 indicating that the voice signal S61 is output from the voice synthesizer to the sound image localization control device 7.

The sound image localization control device 7 has a sound signal S61 and sound image localization position information S62 which are input from the voice synthesizer 6.
And the audio output notification signal S63 and the audio source S4 from the audio system 4 are selected by the following method. That is, the sound image localization control device 7 uses the audio output notification signal S6.
3 is detected, the audio signal S61 is selected regardless of whether or not the audio source S4 is input from the audio system 4, and the audio signal S61 is selected as a low frequency signal connected to each of the plurality of speakers 9. It outputs to each amplifier 8. At this time, the sound image is localized at the target position by controlling the elements related to the sound image localization such as the amplitude and delay of the sound according to the sound image localization position information S62.

If the sound image localization control device 7 does not detect the sound output notification signal S63, the sound source localization control device 7 selectively outputs the sound source S4 from the audio system 4. In this case, the elements related to the sound image localization are adjusted so that the sound image is localized at the position set as the initial value or the position set by the passenger, and the obtained audio sources are output to the low-frequency amplifier 8 respectively. .

The low-frequency amplifier 8 amplifies the input audio signal or audio source to a predetermined level required to drive the speaker 9. The speaker 9 is a low frequency amplifier 8
The signal input from the vehicle is electro-acoustically converted, and the automobile 10
The voice is pronounced to passengers in the car.

Next, each of the constituent elements of this embodiment will be described in more detail.

First, the navigation system 1 will be described. As shown in FIG. 3, the navigation system 1 includes an information processing unit 11, map data 12, a GPS (Global Positioning System) 13, a wheel speed sensor 14, a gyro 15a, a geomagnetic sensor 15b, tourist information 16 and a search list. 17 and a display device 18.

The main purpose of the navigation system 1 is to measure where the vehicle is and present it to the driver. There are roughly two methods for measuring the vehicle position. The first method is radio navigation, in which signals from GPS satellites are received by a GPS receiver 13 and the distance between them is measured to determine the position of the vehicle, or a signal is passed under a transmitter called a sign post. It is a method of obtaining the accurate position information when doing.

The second method is a method called self-contained navigation, in which the speed of the vehicle is measured by the wheel speed sensor 14, and
The direction of travel of the vehicle is a gyro 15a and a geomagnetic sensor 15b.
It is a method of obtaining position information by measuring with and integrating the measurement result. Furthermore, a method called map matching, which determines the vehicle position with higher accuracy by comparing the road shape of the map data 12 with the measurement result, has also been developed.

Another important function of the navigation system 1 is a route guidance function that informs the driver of the road to the destination at any time. The driver searches for and sets a destination from the map data 12 or the search list 17. The information processing unit 11 obtains the shortest time connecting the current location and the destination or the road with the lowest cost, presents it to the driver, and starts the guidance. Further, during traveling, information about which intersection is to be turned in which direction and information to be a target for route guidance such as a post office or a gas station are output as necessary.
Furthermore, the tourist guide information 16 can be used to output guide information when passing near a tourist spot.

First, a method of presenting the vehicle position information to the driver from the navigation system 1 will be described. The navigation system 1 constantly measures the exact position of the vehicle. Therefore, in order to inform the driver of the own vehicle position, the information processing unit 11 compares the own vehicle position calculated by the own vehicle position calculation function with the map data 12, and, for example, near the own vehicle position. Using the names of major points on a certain map data 12, create character information such as "I am driving near Nihonbashi." Or "I entered Shinjuku Ward." . In this case, since it is not necessary to specify the direction in which the sound is heard, the sound image localization position information is set to the front.

As another example, when notifying the driver of the current position from the name of the building, the information processing unit 11
While running on a road with Tokyo Station on the left end of the road, creates character information "I am passing in front of Tokyo Station" and sound image localization position information that localizes the sound image on the left side by the sound image localization position calculation function. The information processing unit 11 outputs the voice information and the sound image localization position information thus created to the voice synthesizer 6 as information S1 by the character / graphic output function.

When the driver gives a tourist guide, the information processing section 11 uses the tourist guide information 16 to provide a tourist guide. For example, it is assumed that the driver accesses the tourist guide information near Yamashita Park while traveling west along the road along the north side of Yamashita Park in Yokohama. First, the information processing unit 11 of the navigation system 1 refers to the vehicle position and the map data 12 and provides character information about Yamashita Park, which is immediately on the left, and sound image localization position information that localizes a sound image on the left side. Created and output as information S1. During this time, the information processing unit 11 constantly calculates the sights that are expected to be seen next and the route to go to another sight, while monitoring that the position of the vehicle changes every moment.

In the case of the above example, other nearby attractions include Yokohama Chinatown on the right, Bay Bridge on the left, and a hill park with a port in front. For example, when the navigation system 1 turns right and approaches an intersection that leads to Yokohama Chinatown, the sound image localization position information is set to the right front, and the words "Yokohama Chinatown is right behind the next intersection." Information is the characters of the information processing unit 11,
It is output by the figure output function. Alternatively, by allowing the driver to select the next tourist destination, for example, the guidance to the Bay Bridge is started and the tourist information of the Bay Bridge is output.

Next, a method of presenting route guidance information to the driver by the navigation system 1 will be described with reference to FIG. The navigation system 1 selects an optimum route from the destination set by the driver and the current location. In FIG. 4, the point A is the current position, the point B is the destination, and the roads to pass through are indicated by thick lines for easy understanding. The navigation system 1 instructs the driver to go straight ahead. Furthermore, the driver has to instruct the driver to turn right at the intersection D as the vehicle advances.

FIG. 5, which is a partially enlarged view of FIG. 4, shows this detail.
Will be explained. The information processing unit 11 shown in FIG.
The character information "Please turn at an intersection." Is created, and at the same time, the route guidance calculation function allows the distance L between the point C and the intersection D in Fig. 5 and the shape of the road from the point C to the intersection D (in this case, (A straight line) and the width W of the road that is advancing, the angle θ formed by the direction v1 of the entrance of the road and the advancing direction v2 of the own vehicle is obtained, and this is output as information S1 using the character / graphic output function. Output to the synthesizer 6.

Next, the safe driving support system 2 will be described. As shown in FIG. 6, the safe driving support system 2 includes an information processing unit 21, an ITV camera 22a, and a radar 22.
b and the storage device 23. The information processing unit 21 has an image processing function, an object position calculation function, an object recognition function, an object velocity calculation function, and an object trajectory prediction function.

The safe driving support system 2 monitors the outside of the vehicle and predicts the danger of, for example, going off the road or colliding with an oncoming vehicle, and outputs information S2 to call the driver's attention. Furthermore, it is possible not only to call attention, but also to provide safe driving support such as preventing accidents by performing active control such as braking or turning the steering wheel. Therefore, the safe driving support system 2 uses the ITV camera 2 in order to obtain information outside the vehicle.
The input device such as 2a and radar 22b is provided. Further, the information processing unit 21 is provided for recognizing the object from the obtained information and calculating the position thereof. Information processing unit 21
Stores such information in the storage device 23 as necessary, and calculates the trajectory of the recognized object using the past information stored in the storage device 23.

A method of extracting an object such as a road shape or a sign by using the ITV camera 22a so that the driver can recognize information necessary for safe driving will be described. The ITV camera 22a photographs the outside of the vehicle and outputs the image data. After performing image processing such as noise removal on the image data, the information processing unit 21 extracts a region having a characteristic such that the same color is continuous or the change in luminance is discontinuous. Then, the object is recognized. Alternatively, the object is recognized by using a feature such that a white line indicating a roadside zone is drawn on the road or a traffic sign is surrounded by a red circle.

FIG. 7 shows an example of image data obtained by photographing the front with the ITV camera 22a when the vehicle is moving forward.
Since the image data has a white line 111 that matches the characteristic of the road in which a white line is drawn at the end of the road, the information processing unit 21 uses the white line 111 obtained by the image processing function to perform the object recognition function. The road is recognized by and the shape is calculated by the object position calculation function. As a result, the information processing unit 2
No. 1 judges that the white line 11 is curved to the right near the center of the screen, and the road is curved to the right,
Curve to the right Character information is created, the position where the road starts to curve is calculated by the object position calculation function, and this is used as the sound image localization position.

Further, if the speed of the own vehicle is known, the information processing section 21 determines whether or not the vehicle can safely turn a curve based on the obtained road shape. If it exceeds the speed at which the vehicle can safely turn, character information such as "It's a curve. Please slow down." Is created and output to the voice synthesizer 6, or the action of slowing down by braking is performed. To do. Further, the information processing unit 21 determines that the area 112 in FIG. 7 is a traffic sign by using the object recognition pattern that the area surrounded by the red circle represents the traffic sign, and the symbol drawn on the traffic sign. By recognizing, for example, the character information "The speed limit is 50 kilometers."
Information S2 in which the direction with a traffic sign is used as sound image localization position information
Is output to the voice synthesizer 6 so that the driver can recognize the speed limit.

Further, the information processing section 21 recognizes the area 113 in FIG. 7 as a destination display board by using the object recognition pattern that the trapezoidal area which is entirely blue is the destination display board by the object recognition function. Then, read the symbols and characters drawn there, and output the character information such as "When you turn left at the intersection 500 meters ahead, you are in the direction of Chiba." Or "I'm currently on Route 6 toward Tokyo." By doing so, the driver's effort to obtain information from the destination display board is reduced. The information obtained from the destination display board is very similar to the information processed by the navigation system 1,
It can also be used as an information source for the navigation system 1.

Next, a method of recognizing an object outside the vehicle by using the radar 22b and notifying the driver of the danger of collision with the vehicle will be described. The radar 22b uses microwaves, millimeter waves,
Irradiate a beam to the range you want to investigate with electromagnetic waves such as visible light, receive the reflected wave obtained by that, find the direction where the object that reflects the electromagnetic wave at the angle of the beam of the received reflected wave, send the beam The distance to the object is obtained by measuring the time from reception to reception. Information processing unit 21
Calculates the spatial position of the object by the object calculation function from these pieces of information.

Next, the trajectory of the object is obtained. This requires knowing the change in position of the object over time. For this reason, the radar 22b is operated every preset time to obtain the position information of the object, and the position information is stored in the storage device 23. If the time interval for operating the radar 22b is arbitrary, it is necessary to store information for knowing the time when the position information is obtained in the storage device 23. By using the information in the storage device 23 as needed, the temporal position change of the object can be known, and the trajectory of the object can be calculated.

The information processing section 21 uses the object trajectory prediction function to predict the future position of the object from this trajectory,
Determine if it will collide with your vehicle. In this way, when it is predicted that an object outside the vehicle will collide with the own vehicle, the information processing unit 21 of the safe driving support system 2, for example, has the character information "I will collide with the preceding vehicle." And the position where the collision object exists. The sound image localization position information for localizing the sound image is output as the information S2 to the voice synthesizing device 6 to alert the driver.

According to the present embodiment, the information on the position to be recognized by the driver can be transmitted in the direction in which the voice is heard. Therefore, when the driver is required to pay attention to the danger that suddenly occurs. However, information can be accurately transmitted. That is, in the present embodiment, by outputting a short word such as "dangerous" or "dangerous" that allows the driver to reflexively recognize the danger, the danger is momentarily recognized and the direction in which the danger is occurring. By making this word audible, the driver can be made aware not only of the danger but also of where to look. As described above, according to the present embodiment, it is possible to provide the driver with necessary information using only very short words without using words such as right and left that require the judgment of the driver.

The operation of the safe driving support system 2 using the radar 22b will be described with reference to FIG. However, in FIG. 8, in order to make the explanation easier to understand, the radar 22b
The beam operating range is linear in the horizontal direction, and the beam is irradiated at regular intervals of Δt to obtain the position information of the object. The information stored in the storage device 23 is
Only one piece of information immediately before.

As shown in FIG. 8A, in the coordinate system in which the width of the vehicle 120 is in the range of 0 to w on the x-axis,
As shown in (C), the oncoming vehicle 130 is different from the own vehicle 120.
8B, the output at the time t1 + Δt is shown together with the output at the time t1 stored in the storage device 23, as shown in FIG. 8B. In this case,
As shown in (B), the information processing unit 21 includes the radar 22b.
Based on the reception output I at time t1 and the reception output II at time t1 + Δt from
Also, at time t1 + Δt, the coordinate positions are different, but the shapes are the same, so it is recognized that the same object is moving.

The information processing section 21 obtains the trajectory of the object by linearly interpolating these two data (FIG. 8 (B)).
It is predicted that the own vehicle 120 and the oncoming vehicle 130 collide with each other at time t2 (see middle and one-dot chain line). Based on this prediction, the information processing unit 21 sets the character information “danger” and the sound image localization position information that the sound image is localized in the direction in which danger is expected (angle θ in the example of FIG. 8) as information S2. ,
Output to the voice synthesizer 6.

Next, the warning sound recognition system 3 will be described. The warning sound recognition system 3 monitors the sound outside the vehicle,
In this system, for example, the system is intended to check the presence or absence of a warning sound such as a siren of an emergency vehicle or an alarm sound at a railroad crossing, and notify the driver of information including the presence or absence of the warning sound and the direction. This system, as shown in FIG.
The information processing section 31, a microphone 32, and a warning sound sampling table 33 are included. The information processing section 31 has a correlation calculation function, a sound source position calculation function, and a warning sound recognition function.

As shown in FIG. 10, the microphones 32 are three microphones 3 installed in the vehicle 120.
2a, 32b and 32c. These microphones 32a, 32b, and 32c are arranged so as to be located at the vertices of a triangle, for example. The three microphones 32a, 32b, and 32c recognize the direction and the type of sound outside the vehicle propagating from a plane parallel to the road.

The information processing section 31 in FIG. 9 calculates the correlation coefficient between the sound data collected by the microphone 32 (32a, 32b, 32c) and the sound data stored in the warning sound sampling table 33. Each is calculated by the correlation calculation function.

Next, when the correlation coefficient exceeds the set value by the sound source position calculation function, the microphone 32 (32a, 32a,
The direction in which the sound comes is calculated from the relative delay amount of each sound input from 32b and 32c). Then, the information processing section 31 extracts the name of the sound from the warning sound sampling table 33 based on the warning sound recognition function, creates text information saying, for example, "Ambulance is approaching." Is output to the voice synthesizer 6 as the information S3 together with the sound image localization position information that the sound image is localized in the direction in which the sound is heard.

Another embodiment of the method for allowing the driver to recognize the sound outside the vehicle will be described below. The warning sound recognition system 3 determines the type of sound and the direction in which the sound is heard by the above method based on the correlation between the sound input from the microphone 32 and the sound data registered in the warning sound sampling table 33. When determining that the sound picked up by the microphone 32 is a warning sound, the information processing section 31 reads the warning sound itself from the warning sound sampling table 33 instead of the above-mentioned character information, and the information S3 together with the sound image localization position information. Is output to the voice synthesizer 6 so that the driver recognizes the warning sound.

Next, the audio system 4 will be described. The audio system 4 is composed of a sound reproducing device such as a radio, a cassette tape recorder, a compact disc, and a television, and a device such as a volume, an equalizer, and a balancer which adjusts a volume and a waveform. The device selected by the passenger is selected by the passenger. Operates to output a sound source S4 having a desired volume and waveform to the sound image localization control device 7.

Next, the voice synthesizer 6 will be described.
The voice synthesizer 6 receives character information and sound image localization position information from one or more of the navigation system 1, the safe driving support system 2, the warning sound recognition system 3, and the audio system 4, and outputs a voice based on this information. Convert to information and output. However, when character information and sound image localization position information are simultaneously input from a plurality of systems, they cannot be converted into voice information. Therefore, the speech synthesizer 6 always selects information with high priority, during that time, information with low priority is stored in the buffer, and after information with high priority is output, the priority of information stored in the buffer is changed. By outputting low information, it is possible to prevent multiple audio information from being output at one time.

Further, the voice synthesizer 6 separates the selected input information into character information and sound image localization position information, synthesizes a voice from the character information and outputs it as a voice signal S61 to the sound image localization controller 7. The sound image localization position information is used as the sound image localization position information S62, and a voice output notification signal S63 indicating the period during which the voice signal S61 is being output from the voice synthesizer 6 is generated and output to the sound image localization controller 7. .

It will be further described that the voice synthesizer 6 selects the input information having the highest priority from the plurality of input information. In consideration of urgency and safety, the priority is set such that the information S2 from the safe driving support system 2, the information S3 from the warning sound recognition system 3, and the information S1 from the navigation system 1 have higher priority in this order. . Also, if there is input information from the same system, the previously input information is controlled to be output preferentially by voice, and the information in the waiting state is saved in the buffer and output after the previous voice output. .

For example, while the voice synthesizing device 6 is outputting a voice based on the route guidance information S1 input from the navigation system 1, information S2 that the vehicle is about to collide with an oncoming vehicle is displayed. When the information is input from the safe driving support system 2, the information S1 is temporarily saved in the buffer, the information S2 having a high priority is selected, and the voice is synthesized based on the character information included in the information S2. Output and inform the driver of the danger. After that, the voice synthesis device 6 performs voice synthesis based on the information S1 saved in the buffer,
Continue the route guidance.

Further, for example, the navigation system 1
If the vehicle position information and the route guidance information are continuously input from, the route guidance that is input later is output while voice synthesis is performed based on the previously input vehicle position information. Store information in a buffer. Then, after the output of the vehicle position information that has been input earlier is completed, the voice synthesizer 6 reads the route guidance information that has been input after it has been stored in the buffer, synthesizes the voice, and outputs it to the sound image localization controller 7. To do.

The above operation example is a case where priority information is given to the speech synthesizer 6 in advance, but an embodiment in which each system decides the priority according to the importance of the output voice information is also used. Conceivable. In this case, each system is shown in FIG.
As shown in FIG. 5, the output system name a, the character information b, the sound image localization position information c, and the data format information in which the priority information d is added are output to the voice synthesizing device 6, and the voice synthesizing device 6
Determines the information to be selected based on this priority information d. Further, the voice synthesizer 6 may preferentially select the set information when the driver sets the particular information to be prioritized.

Next, the sound image localization control device 7 will be described. In the present embodiment, a voice source S4 from the audio system 4 and a voice signal S61 from the voice synthesizer 6 are generated as the sound information, but these need to be localized at the sound image positions adapted to each. The sound image localization control device 7 selects one of these pieces of sound information so that the sound image can be localized at a position suitable for each.
For example, when the sound image localization control device 7 receives the voice output notification signal S63 from the voice synthesis device 6, the sound image localization control device 7 outputs the voice signal S61.
Is selected, and if not, the output audio source S4 of the audio system 4 is selected. Alternatively, the information on the sound designated by the driver may be selected.

The sound image localization method of the sound image localization controller 7 will be described. When there is only one sound image, the direction from which the sound is heard matches the direction of the sound source. However, if there are multiple sound sources, as can be seen from the stereo system, the localization position of the sound image can be moved to change the direction in which the sound is heard. Therefore, the present embodiment utilizes this, and provides a safer information presentation method with less burden on the driver.

Specifically, the localization position of the sound image is controlled by adjusting the amplitude difference and time difference of the sounds output from the speakers, which are necessary for localization of the sound image. Of the principles of sound image localization using these elements, the first principle is
This is the principle of changing the localization position of the sound image by changing the amplitude difference of the sound output from each speaker, which will be described first. As shown in FIG. 12, the distance from the point sound source 142 to the left ear 141L of the listener 140 is d1, and the right ear 1 is
If the distance to 41R is d2 and the distances are different, the sound reaching the ear with a longer distance is attenuated by the difference Δd (= | d2-d1 |), so that both ears hear it. Differences occur in the amplitude of the audio that is heard.

The principle of changing the localization position of the sound image by changing the amplitude difference of the sound output from each speaker utilizes that the listener recognizes the direction of the point sound source 142 from this difference Δd. That is, if the speakers are placed at the two vertices of an equilateral triangle and the speakers are heard from the left and right at the position of the remaining one vertex, the sounds from the speakers are heard, but the same sound is output from each speaker with no amplitude difference. In this case, the amplitudes of the sounds received by the left and right ears 141L and 141R are the same, and the sound image is in the front (center of the two speakers).

When the audio output of one speaker, for example, the left speaker, is gradually decreased from this state, the left and right ears 1
The amplitude of the sound received by 41L and 141R is 1
Since 41R becomes relatively larger, the sound image approaches the right speaker. On the contrary, when the sound output of the left speaker is increased, it seems that the sound image gradually approaches the left speaker.

The second principle for localizing a sound image is to change the localization position of the sound image by changing the time difference of the sound output from each speaker. According to this principle, FIG.
As shown in, when the distance from the point sound source 142 to the left and right ears 141L and 141R of the listener 140 is different, there is a difference in the time of sound reaching the left and right ears 141L and 141R. Kara point sound source 142
Utilizing that the direction of is recognized.

That is, if the speakers are placed at the two vertices of an equilateral triangle and the speakers are heard from the left and right at the position of the remaining one vertex, the sounds from the speakers are heard and there is no time difference between the speakers. When the sound is pronounced in, the time difference between the sounds received by the left and right ears 141L and 141R is zero, and the sound image is in the front (center of the two speakers).

Further, for example, when delay is applied to the sound output from the left speaker for 1 millisecond, the right ear 141R
Since the sound from the right speaker without delay is mainly heard and the left ear 141L mainly hears the sound from the left speaker with delay, there is a time difference between the sounds received by both ears and the sound image is It depends on the speaker on the right side. Conversely, when the delayed audio signal is sounded from the right speaker, the sound image moves toward the left speaker. Increasing the time difference between the sounds output from the left and right speakers also increases the amount of movement of the sound image. However, if the time difference between the sounds output from the two speakers is too large (for example, 50 msec or more when the distance from the speakers is 3 meters), the listener cannot recognize the relationship between the sounds from the speakers, It will be received as a separate sound from each speaker.

The localization position of the sound image can be controlled by combining the above two principles. For example, if a sound is output from the left and right speakers in the same manner and the sound output from the left speaker is delayed, the sound image moves to the right. However, if the delayed voice output of the left speaker is increased, the sound image can be returned to its original position.

An example in which the sound image is localized at a desired position by combining these two principles when the speakers are arranged asymmetrically with respect to the driver will be described with reference to FIG. In FIG. 13, the driver 150 uses the speakers 9L and 9R for the speaker 9L and the speaker 9R, respectively.
Since it is not on the bisector that connects the two, the sound image is localized at a position deviated from the front of the driver 150 even if the same audio output is made from each of the speakers 9L and 9R.

Therefore, first, a time difference is used as a means for correcting the deviation of the localization position of the sound image. Letting TL and TR be the times at which the voices reach the driver 150 located at the distances LL and LR from the left and right speakers 9L and 9R, respectively, the voices emitted from the left and right speakers 9L and 9R are divided into times DL and DR, respectively. For the delay, the sound produced by the left and right speakers 9L and 9R is output to the driver 1
By setting the total time TL + DL, TR + DR until reaching 50 to be equal, the sound image is localized in front of the driver 150.

Next, the delay time applied to the voice output of the speakers 9L and 9R is kept as it is, and the speaker 9L
By controlling the amplitude of the sound output from L and 9R, the sound image can be localized at the sound image localization position included in the information from the navigation system 1, the safe driving support system 2, and the warning sound recognition system 3. That is, since the asymmetrical arrangement of the speakers 9L and 9R has already been corrected, by making the amplitude of the sound produced from the right speaker 9R larger than that from the left speaker 9L. , Sound image driver 15
It can be moved to the right with respect to the front of 0, and vice versa.

However, in reality, the characteristics of the sound propagating in the vehicle, such as the shape of the vehicle and the sound absorption by the seat, or the reflection from the glass, and the mutual interference when a large number of speakers are arranged must be taken into consideration. I have to. Therefore, as shown in FIG. 1, the sound image localization control device 7 uses the in-vehicle propagation characteristic table 71 that stores the influence of the sound transmission due to the shape inside the vehicle and the object inside the vehicle, and the output device position that stores the speaker arrangement. You need to have a table 72.

As described above, referring to these tables 71 and 72, the sound signal whose sound image position is controlled by the sound image localization control device 7 is amplified by the low frequency amplifier 8 to a level at which the speaker 9 can be driven. , Is input to the speaker 9 and is sounded.

Next, an arrangement example of the speaker 9 will be described. In the embodiment shown in FIG. 1, four or more speakers are used, three of which are arranged so that one surface can be defined, and at least one of the remaining speakers is arranged not on this surface. Specifically, the sound image is stereoscopically localized by using a total of eight speakers, namely, left and right above the front part of the vehicle, left and right below the front part, left and right above the rear part of the vehicle, and left and right below the rear part. .

The arrangement of the loudspeakers 9 is not limited to this, and three or more loudspeakers are used, and two of the loudspeakers are arranged so that one straight line can be defined. One is that the sound image may be localized in a plane by arranging it so that it is not in a straight line.
Shown in. In FIG. 14, two left and right speakers 9a and 9b are arranged at the same height position in the front part of the automobile 160, and two left and right speakers 9c and 9d are arranged at the same height position in the rear part of the car. With this configuration, it consists of four speakers in total. This arrangement is adopted in many of the current car audio systems, and its effect is great when the present invention is applied to such a speaker configuration.

As another speaker arrangement, as shown in FIG. 15, two or more speakers are used and all the speakers are arranged in one straight line so that the sound image can be linearly localized. But good. FIG. 15 shows an automobile 160
In the example in which two left and right speakers 9a and 9b are arranged at the same height in the front part of the vehicle, the range in which the sound image can be localized is only between the two speakers 9a and 9b. The present invention can be applied in any case.

The sound output from each speaker having such a speaker arrangement can be recognized by the driver in the direction in which the sound is heard. In the present invention, this voice includes information about the direction in which the user wants to proceed or the direction in which attention needs to be paid. This eliminates the need to distinguish between words such as right and left, which can increase the burden on the driver and also enable accurate transmission of information even in an emergency.

Next, a second embodiment of the present invention will be described. FIG. 16 shows a block diagram of the second embodiment of the present invention. In the figure, the same components as those in FIG. 1 are designated by the same reference numerals, and the description thereof will be omitted.

In the first embodiment described above, the localization position of the sound image is controlled using a plurality of speakers to change the direction in which the sound is heard. However, even if the sound from one speaker is heard from a certain direction, moving the position of the speaker, or selecting one of the multiple speakers and outputting the sound, Can change the direction of arrival. The present embodiment is an embodiment in which the direction of arrival of voice is changed by moving the position of the speaker.

In FIG. 16, when the voice output notification signal S63 is input from the voice synthesizer 6, the position calculation device 5 outputs the voice signal S61 from the voice synthesizer 6 to the voice information S.
The sound image localization position information S6
The position of the speaker 9 is calculated based on 2 and output as position information S52. On the other hand, when the voice output notification signal S63 is not input from the voice synthesizer 6, the position calculation device 5 outputs the voice source S4 from the audio system 4 to the voice information S.
In addition to outputting 51, the preset speaker position is output as position information S52.

The motor driving device 210 is the position calculating device 5
The position of the speaker 9 is moved by driving and controlling the motor 220 based on the position information S52 from. That is, the speaker 9 is the rail 2 drawn so as to surround the driver.
The position of the motor 30 can be moved by the motor 220. The voice information S51 amplified by the low-frequency amplifier 8 is input to the speaker 9 and sounds. The movement of the position of the speaker 9 controls the localization position of the sound image.

In the second embodiment shown in FIG. 16, one speaker 9 is moved on one rail 230. However, a plurality of speakers are moved on one rail, or the number of rails is changed. The number of movements may be increased so that at least one speaker can move on each rail, and the movement amount per speaker can be reduced.

Next, a third embodiment of the present invention will be described. FIG. 17 shows a block diagram of the third embodiment of the present invention. In the figure, the same components as those in FIG. 1 are designated by the same reference numerals, and the description thereof will be omitted.

This embodiment utilizes the fact that the sound from one speaker is heard from a certain direction, and by selecting one of a plurality of arranged speakers and outputting the sound, the arrival of the sound. It is designed to change direction.

In FIG. 17, inside the automobile 10,
Ten speakers 9 are arranged so as to surround the driver. When the voice output notification signal S63 is input from the voice synthesizer 6, the switching device 310 sets 1 based on the sound image localization position information S62 during the input period of the voice output notification signal S63.
One of the zero speakers 9 is selected to output the audio signal S61 from the audio synthesizer 6. On the other hand, when the voice output notification signal S63 is not input from the voice synthesizer 6, the switching device 310 operates the audio system 4
The audio source S4 from the device is output to a preset specific speaker position.

The present invention is not limited to the above embodiment, and it is conceivable to use a known binaural method as a method for recognizing the arrival direction of voice. The binaural method is a method in which the human beings use the sounds themselves heard by the left and right ears separately. For example, microphones are installed in both ears of a human being (or a dummy head resembling a human head), The voice picked up by the microphone at the position and the voice picked up by the microphone at the right ear are recorded separately, the former recorded voice is reproduced at the left ear, and the latter recorded voice at the right ear. When played back, the sound source can be recognized in the same positional relationship as when it was recorded.

When this binaural method is applied to the present invention, some sounds in which the position of the sound source is changed are recorded in advance, and these sounds are selected and reproduced depending on the situation, or the shape of the driver's head is changed. It is realized by using a sound image localization control device that takes into consideration.

In each of the above embodiments, a description is not given for the case where a display device is used in combination, but the liquid crystal display device (LC
D), cathode ray tube (CRT), HUD (Head Up)
A variety of information can be presented by combining a display device such as a display.

FIG. 18 shows an embodiment in which HUDs are combined. In the figure, 400 is the steering wheel of the own vehicle, 41
Reference numeral 0 is a rear-view mirror, and when a pedestrian 430 crossing a pedestrian crossing in front of the vehicle is visible through the windshield 420, the HU is placed so that the pedestrian 430 is overlapped with the visible position.
While using D to output the yellow blinking light 440,
A voice 450 saying "There is a pedestrian"
The sound image can be localized and output at the position of 0.

Further, as the information output system in the present invention, the navigation system 1, the safe driving support system 2 and the warning sound recognition system 3 have been described in the respective embodiments, but other than this, it is also applicable to an in-vehicle monitoring system. is there. This monitoring system is a system that monitors an abnormality in the interior of an automobile and outputs at least character information indicating the state of a monitoring location and sound image localization position information for locating a sound image at the monitoring location as needed. As a result, the information displayed by a device such as a meter or a warning light arranged in the instrument panel in the vehicle can be explained in an easily audible manner. For example, a sound image is localized on the speedometer and speed information or speed limit excess information is presented by voice, or a sound image is localized on the fuel meter to prompt how much fuel remains and replenishment information. To present. Also, when the vehicle starts driving with a half-door, the sound image is localized at the door that is a half-door to output a voice alerting the driver, or with the side brakes applied When the vehicle starts driving, the sound image can be localized on the side brake lever to output the information prompting the user to release the side brake.

[0092]

As described above, according to the present invention,
The sound image synthesizing device forming the sound image control means selects one by one from the most necessary information in that situation in order, converts it into an audio signal and outputs it to the acoustic output device. The optimum voice can be obtained in a form that the driver can easily recognize without imposing a burden on the driver.

Further, in the present invention, since the sound image is localized at the optimum position of the selected information, the driver only needs to recognize the output voice and act, and take the action corresponding to the driving situation at that time. Therefore, even in the case of particularly urgent information, the driver does not need to read a long sentence or a word that takes time to recognize such as right and left, and immediately takes necessary action from the sound image position. be able to.

Furthermore, according to the present invention, the voice synthesizer can be shared by a plurality of information output systems, and when the synthesized voice signal from the voice synthesizer is not output, the voice source from the audio system is After performing the sound image localization processing based on the sound image localization position information, since it is configured to output to the acoustic output device, it is possible to share the acoustic output device such as a speaker in a plurality of information output system and audio system, Cost reduction can be realized by reducing the number of parts.

[Brief description of drawings]

FIG. 1 is a block diagram showing a configuration of a first exemplary embodiment of the present invention.

FIG. 2 is an explanatory diagram showing an example of an output information data format of the navigation system.

FIG. 3 is a block diagram of an embodiment of a navigation system.

FIG. 4 is an operation explanatory diagram of the navigation system.

FIG. 5 is a partially enlarged view of FIG.

FIG. 6 is a block diagram of an embodiment of a safe driving support system.

FIG. 7 is an explanatory diagram showing an example of an image taken by an ITV camera of the safe driving support system.

FIG. 8 is an operation explanatory diagram of the safe driving support system.

FIG. 9 is a block diagram of an embodiment of a warning sound recognition system.

FIG. 10 is an explanatory diagram showing a state in which a microphone required for a warning sound recognition system is installed in an automobile.

FIG. 11 is an explanatory diagram showing an example of a data format of output information of the navigation system.

FIG. 12 is an explanatory diagram illustrating a mechanism for recognizing a localization position of a sound image.

FIG. 13 is an explanatory diagram illustrating a case where the position of the speaker is not symmetrical with respect to the driver.

FIG. 14 is a perspective view showing an example of arrangement of speakers.

FIG. 15 is a perspective view showing another example of arrangement of speakers.

FIG. 16 is a block diagram showing a configuration of a second exemplary embodiment of the present invention.

FIG. 17 is a block diagram showing a configuration of a third exemplary embodiment of the present invention.

FIG. 18 is an explanatory diagram showing an embodiment in the case where the present invention and HUD are combined.

[Explanation of symbols]

 1 ... Navigation system 2 ... Safe driving support system 3 ... Warning sound recognition system 4 ... Audio system 5 ... Position calculation device 6 ... Voice synthesizer 7 ... Sound image localization control device 8 ... Low frequency amplifier 9, 9a-9d, 9L, 9R ... Speaker 11, 21, 31 ... Information processing unit 32, 32a to 32c ... Microphone 33 ... Warning sound sampling table 71 ... In-vehicle propagation characteristic table 72 ... Output device position table S1 ... Navigation system output information S2 ... Safe driving support system Output information S3 ... Output information of warning sound recognition system S4 ... Output information of audio system S61 ... Audio signal S62 ... Sound image localization position information S63 ... Audio output notification signal

 ─────────────────────────────────────────────────── ─── Continuation of the front page (72) Inventor Atsuko Takamura 7-1-1 Omika-cho, Hitachi-shi, Ibaraki Hitachi Ltd. Hitachi Research Laboratory

Claims (14)

[Claims] 1. A plurality of information output systems for outputting information transmitted by voice to an occupant of an automobile together with sound image localization position information, one or more acoustic output devices installed in the interior of the automobile, and a plurality of the plurality of acoustic output devices. One of the information from the information output system is selected as information to be transmitted by voice, the information is converted into a voice signal, and the sound is generated so that the sound image localization according to the sound image localization position information is obtained. An audio system integrated system for a vehicle, comprising: a sound image control means for outputting to an output device. 2. The plurality of information output systems is a device that outputs at least a pair of character information that is transmitted to a driver by voice and sound image localization position information that localizes a sound image, and the sound image control means is configured to output the plurality of sound image control means. The information output system sequentially selects each of the pieces of information and outputs a synthesized voice signal based on the selected character information, and a synthesized voice signal from the voice synthesizer forms a pair of the synthesized voice signal. The vehicle-mounted acoustic device integration system according to claim 1, comprising a sound image localization control device that performs sound image localization processing based on the sound image localization position information and outputs the sound image localization processing to the sound output device. 3. The sound image localization control device outputs the sound from an audio system which outputs at least a pair of a sound source and sound image localization position information of the sound source when a synthesized sound signal is not input from the sound synthesizing device. 3. The vehicle-mounted acoustic device integration system according to claim 2, wherein the source is subjected to sound image localization processing based on the sound image localization position information and then output to the acoustic output device. 4. Each of the plurality of information output systems outputs, together with the character information and the sound image localization position information, priority information that determines a priority between the plurality of information output systems, and the voice synthesizer includes: 3. The vehicle-mounted acoustic device integration system according to claim 2, wherein output information from the plurality of information output systems is selected based on the priority information and is output as a synthetic voice. 5. The sound output device has four or more speakers arranged so as to surround a driver of the automobile, and three speakers of the four speakers are arranged so as to define one surface. The at least one of the remaining speakers is arranged at a position avoiding this surface, and the vehicle-mounted acoustic device integrated system according to claim 1. 6. The sound output device has two or more speakers, wherein at least two speakers are arranged so that one straight line can be defined, and when there are remaining speakers, at least one of them is provided. The vehicle-mounted acoustic device integration system according to claim 1, wherein is arranged at a position avoiding the straight line. 7. The sound image control means localizes the sound image at a designated position by adjusting the amplitude and time difference of the sound produced by each speaker according to the sound image localization position information. 6. The vehicle-mounted acoustic device integration system according to item 6. 8. The vehicle-mounted acoustic apparatus according to claim 5, wherein the sound image control means causes a speaker located at a position selected according to the sound image localization position information among the plurality of speakers to generate a sound. Integrated system. 9. The sound output device has a rail arranged so as to surround a driver and a speaker adapted to move on the rail, and a motor for moving the speaker is provided, and the sound image is provided. The control means inputs an audio signal to the speaker based on one selected information of the plurality of information output systems, and drives the motor according to the sound image localization position information of the selected one information to move the speaker to the sound image position. The vehicle-mounted acoustic device integrated system according to claim 1, wherein the movement control is performed up to. 10. An information output system of one of the plurality of information output systems, at least character information indicating a direction desired to be recognized by a driver, including at least a direction in which a vehicle is guided, and sound image localization position information. The vehicle-mounted acoustic device integration system according to claim 1 or 2, which is a navigation system for outputting. 11. An information output system of one of the plurality of information output systems outputs at least character information urging a driver to drive safely including at least a direction in which danger is predicted and sound image localization position information. The vehicle-mounted acoustic device integrated system according to claim 1 or 2, which is a safe driving support system. 12. An information output system, one of the plurality of information output systems, includes a sound collecting unit that collects sound outside the vehicle, a sampling table that stores sampling data of warning sounds in advance, It is determined whether the correlation calculated from the voice data from the sound means and the warning sound data from the sampling table is equal to or more than the set value. When the correlation is equal to or more than the set value, the warning sound information is converted into the sound image localization information. The vehicle-mounted acoustic device integration system according to claim 1 or 2, which is a warning sound recognition system including an information processing unit that outputs together. 13. The sampling table in the warning sound recognition system stores the name of the warning sound in association with the sampling data of the warning sound, and the information processing unit sets the correlation to be equal to or more than a set value. 13. At least the character information indicating the type of warning sound and the sound image localization position information for localizing a sound image in the direction in which the warning sound is heard are output at least. . 14. An information output system, one of the plurality of information output systems, monitors each part in the vehicle,
3. The vehicle-mounted abnormality detection system according to claim 1, wherein the abnormality detection system outputs at least character information indicating a state of a monitoring point and sound image localization position information for localizing a sound image at the monitoring point, if necessary. Sound device integration system.