JP6940320B2 - Sound output device - Google Patents

Description

The present invention relates to a sound output device that outputs a notification sound to a passenger of a moving body.

Conventionally, there is one that outputs a notification sound to a vehicle driver, for example, one disclosed in Japanese Patent Application Laid-Open No. 2010-208606 (Patent Document 1). In this conventional technique, when an obstacle is detected, the sound image localization of the notification voice (notification sound) for notifying the existence of the obstacle is localized in the detected direction so that the driver can recognize the obstacle.

JP-A-2010-208606

In the conventional technology, the sound image localization of the notification sound is uniquely performed regardless of the control state of the vehicle, for example, automatic driving or manual driving, and the driver's state such as whether the driver is concentrating on driving or awake. Depending on the situation, a notification sound that makes the driver feel annoyed may be output.

An object of the present invention is to provide a sound output device capable of outputting an appropriate notification sound according to a situation to a passenger of a moving body.

In order to solve the above problem, the invention according to claim 1 is a notification sound information acquisition unit that acquires information on a notification sound to a passenger of a moving body, and a sound that estimates the sensitivity of the passenger regarding sound recognition. The sensitivity estimation unit includes a sound image localization control unit that changes the sound image localization of the notification sound to the passenger based on the sensitivity estimated by the sound sensitivity estimation unit, and the sound image localization control unit is the boarding. The sound output device is characterized in that when the sensitivity of a person's sound recognition is low, the sound image localization is brought closer to a specific position of the passenger than when the sensitivity is high.

The invention according to claim 9 includes a notification sound information acquisition step of acquiring information on a notification sound to a passenger of a moving body, a sound sensitivity estimation step of estimating the sensitivity of the passenger regarding sound recognition, and the above-mentioned invention. the sound image localization of alarm signals to the occupant, and the sound sensitivity estimation step sound image is changed based on the sensitivity estimated in localization control process, look including the, in the sound image localization control process relates to a sound recognition of the passenger This is a sound output method characterized in that when the sensitivity is low, the sound image localization is closer to a specific position of the passenger than when the sensitivity is high.

The invention according to claim 10 is a sound output program characterized in that the sound output method according to claim 9 is executed by a computer.

It is a schematic block diagram of the sound output apparatus of one Example of this invention. It is a functional block diagram of the sound output device of one Example of this invention. The program executed by the computer of the sound output device according to the embodiment of the present invention is a flowchart.

Hereinafter, the sound output device according to the embodiment of the present invention will be described. The sound output device according to the embodiment of the present invention includes a notification sound information acquisition unit that acquires information on a notification sound to a passenger of a moving body, and a sound sensitivity estimation unit that estimates the sensitivity of the passenger regarding sound recognition. It is provided with a sound image localization control unit that changes the sound image localization of the notification sound to the passenger based on the sensitivity estimated by the sound sensitivity estimation unit. Therefore, it is possible to output an appropriate notification sound with sound image localization according to the sensitivity of the passenger regarding sound recognition.
Further, when the sensitivity of the passenger regarding sound recognition is low, the sound image localization control unit brings the sound image localization closer to the specific position of the passenger than when the sensitivity is high. The specific position is, for example, the passenger's ear or overhead, and the notification sound can be output to a unique position that is not normally experienced.

In addition, the sound sensitivity estimation unit estimates the sensitivity of the occupant regarding sound recognition based on the occupant state information including the occupant's biological information. The occupant status information is, for example, the occupant's heart rate, the frequency of blinking, the frequency of yawning, the degree of concentration of driving, and the like, and the notification sound can be output with a sound image localization suitable for the occupant's condition.

Further, the mobile body state detecting unit for detecting the moving body state including the state related to the sound in the moving body is provided, and the sound sensitivity estimation unit is based on the moving body state detected by the moving body state detecting unit. Estimate the sensitivity of passengers to sound recognition. The moving body information is, for example, the state of the content reproduction sound in the vehicle, and the notification sound can be output with the sound image localization suitable for the state of the vehicle.

Further, the sound image localization control unit includes an importance determination unit that determines the importance of the notification sound based on the type information of the notification sound acquired by the notification sound information acquisition unit as information related to the notification sound. The sound image localization is changed according to the sensitivity and the importance. As a result, the notification sound can be output with the sound image localization according to the importance of the notification sound.

Further, the operation control information acquisition unit for acquiring the operation control information related to the operation control of the moving body is provided, and the sound image localization control unit changes the sound image localization according to the operation control information and the sensitivity and the importance. Let me. The driving control information is information indicating the control state of the vehicle such as whether the vehicle is automatically driven or manually driven, and can output a notification sound with a sound image localization suitable for the state of the vehicle.

Further, when the importance is determined by the importance determination unit, the sound image localization control unit sets the sound image localization to a specific position of the passenger regardless of the sensitivity. As a result, the notification sound can be output with the sound image localization according to the importance of the notification sound.

In addition, the sound sensitivity estimation unit detects the arousal level and / or the driving concentration level of the occupant as the occupant state information.

In addition, the moving body state detecting unit detects a state related to the sound reproduced by the content reproducing device in the moving body as the moving body state.

Further, the sound output method according to the embodiment of the present invention includes a notification sound information acquisition step of acquiring information on a notification sound to a passenger of a moving body, and a sound sensitivity estimation for estimating the sensitivity of the passenger regarding sound recognition. a step, the sound image localization of alarm signals to the passenger, looking contains a sound image localization control step of changing, based on the sensitivity estimated by the sound sensitivity estimation step, in the sound image localization control process, the passenger When the sensitivity regarding sound recognition is low, the sound image localization is closer to the specific position of the passenger than when the sensitivity is high .

Further, it may be a sound output program in which the above-mentioned sound output method is executed by a computer.

The sound output device according to the embodiment of the present invention will be described with reference to FIGS. 1 to 3.

FIG. 1 is a schematic configuration diagram of a sound output device according to an embodiment of the present invention, and FIG. 2 is a functional block diagram of the sound output device according to the same embodiment.

As shown in FIG. 1, the sound output device of the embodiment is a control unit 1 mounted on a vehicle and operated by a computer or the like, a storage device 2 that stores a sound output program or the like of the embodiment of the present invention, a DPS, or the like. Input to input sound source device 3, sound system 4 consisting of multiple speakers, various data from navigation device, biometric information from biosensor (pulse sensor, etc.), image data from in-vehicle camera, etc. It is equipped with system 5.

In the functional block diagram of FIG. 2, the navigation unit outputs, for example, a navigation guidance sound for guiding a driving route. The driving support information output unit outputs information on the braking notice of the vehicle (for example, "Move to the right lane", "Emergency stop", etc.) during automatic driving, and the lane during manual driving. It outputs information on safe driving support such as deviation warning and inter-vehicle distance warning. Then, the "notification sound source information" includes the navigation guidance sound from the navigation unit, the notification sound such as the braking warning sound and the danger warning sound from the driving support information output unit, and the type information indicating the type of the notification sound. This is information to be included, and this information is input to the notification sound image localization control unit.

Further, in the functional block diagram of FIG. 2, the automatic driving control unit automatically controls all or part of the driving operations of acceleration, steering, and braking. More specifically, in automatic driving, automatic control of acceleration, steering, and braking differs depending on the automatic driving level. The automatic driving control unit outputs information indicating whether the vehicle is automatically driven or manually driven, information indicating the control state of the vehicle according to the automatic driving level, and the like. In addition, the content reproduction unit has the following functions. For example, the content reproduction referred to here is the reproduction of packaged media such as CDs and DVDs, the reproduction of broadcast contents such as televisions and radios, the reproduction of contents acquired by wireless communication, and the like, and the images to be viewed by passengers. This includes playback of audio. The content reproduction unit outputs the content information being reproduced. The "vehicle state information" is information output by the automatic driving control unit, information such as content information output by the content reproduction unit when the content reproduction unit is playing, and these information are notification sounds. It is input to the sound image localization control unit.

The "driver monitoring unit" estimates the alertness of the driver of the vehicle, the concentration of driving, and the like using a heart rate sensor, an in-vehicle camera, and the like, and outputs information indicating the estimated state. The driver's alertness is determined by a decrease in heart rate, frequency of blinking, frequency of yawning, and the like. The degree of driving concentration is determined by the frequency of inattentiveness. Then, the information indicating these estimated states is input to the notification sound sound image localization control unit.

The "notification sound image localization control unit" includes a "notification sound importance determination unit", a "sensitivity determination unit", and a "sound image localization control unit". The "notification sound importance determination unit" determines the importance of the notification sound from the type of the notification sound included in the notification sound source information and the vehicle state information. The "sensitivity determination unit" determines the sensitivity to the driver's notification sound based on the vehicle state information, the arousal level, and the driving concentration level. The "sound image localization control unit" controls the sound image localization of the notification sound according to the sensitivity to the determined notification sound.

The "notification sound output unit" is composed of a sound source device 3 composed of a DSP or the like and an acoustic system 4 such as a plurality of speakers. The notification sound output unit changes the driver's recognition of the direction and distance of the sound source of the notification sound (sound image localization of the notification sound) based on the control by the sound image localization control unit. In other words, the notification sound output unit processes the notification sound so that the position of the virtual sound source of the notification sound changes based on the control by the sound image localization control unit, and then outputs the notification sound.

FIG. 3 is a flowchart of a sound output program executed by a computer in the control unit 1 of the sound output device of the embodiment. It should be noted that this flowchart is a main flowchart of the control program executed by the computer (the CPU thereof) of the control unit 1, and is configured as a subroutine for the main processing of the control program.

First, the sound reproduction instruction process is executed in step S1. In step S1, the reproduction instruction of the notification sound output from the navigation unit and the driving support information output unit, and the information of the type of the notification sound are received, and the process proceeds to step S2. In the sound importance determination process of step S2, the importance of the notification sound instructed to be played back in step S1 is determined by the type of the received notification sound (for example, navigation guidance sound, braking warning sound, danger warning sound, etc.), and At this time, the determination is made from the vehicle control state (automatic driving / manual driving or automatic driving level) acquired from the automatic driving control unit.

In this importance determination process, the importance of the notification sound is set as follows, for example. The state of low importance is the case of a notification sound (navigation guidance voice during automatic driving, etc.) that has little effect even if the driver misses it. The state of medium importance is a notification sound that does not cause a sudden change in the control of the vehicle (for example, a navigation guidance voice during manual driving, a lane change notification during automatic driving, etc.). Further, the state of high importance is the case of a notification sound that causes a sudden change in the control of the vehicle (for example, a sudden braking notification during automatic driving, an obstacle warning during manual driving, a lane deviation warning, etc.). Alternatively, the importance of each type of notification sound may be determined according to the level of automatic operation. Then, when the importance is medium, the process proceeds to step S3, when the importance is high, the process proceeds to step S6, and when the importance is low, the process proceeds to step S7.

In the sound sensitivity determination process of step S3, the driver's sensitivity to the notification sound for which the reproduction instruction is given is determined. This sensitivity is determined from the reproduction state of another sound source (for example, the reproduction sound of the content being reproduced) at this time, the driver's arousal degree estimated by the driver monitoring unit, the driver's driving concentration degree, and the like. For example, regarding the playback state of other sound sources, "NG" if playback is in progress, "OK" if playback is stopped, "NG" if the driver's alertness is low, and "NG" if the driver's alertness is high. Regarding "OK" and the driving concentration, if the driver's driving concentration is low, "NG" is evaluated, and if the driver's driving concentration is high, "OK" is evaluated for each element. If any of the above three factors is "NG", the driver's sensitivity is "low", and if all are "OK", the driver's sensitivity is "high". The above determination condition is an example and may be set as appropriate. For example, if there are two or more "OK", the sensitivity may be determined to be "high".

Then, when the sensitivity is low, the process of setting the sound image localization of the notification sound to the ear (specific position) is performed in step S4, and when the sensitivity is high, the process of setting the sound image localization of the notification sound to the standard position in step S5. Is performed, and the process proceeds to step S8.

On the other hand, if it is determined in step S2 that the importance is high and the process proceeds to step S6, the process of setting the sound image localization of the notification sound to the ear is performed in step S6, and the process proceeds to step S8. Further, when it is determined in step S2 that the importance is low and the process proceeds to step S7, the process of setting the sound image localization of the notification sound to the standard position is performed in step S7, and the process proceeds to step S8.

Here, in the process of setting the sound image localization of the notification sound in steps S4 and S6 to the ear, the sound image localization of the notification sound specified in step S1 is set so that it can be heard by the driver's ear. The position of the ear is an example of the "specific position", and the "specific position" is not limited to the ear and may be localized to a specific position (for example, overhead). In this way, the notification sound can be heard from a peculiar position that is not normally experienced, and the driver can easily recognize the notification sound. The sound image localization can be controlled in real time (for example, processing by DSP), or multiple sound sources that have the same original sound source but different localization locations are prepared in advance, and which sound source is to be played back in a timely manner. May be selected.

In the process of setting the sound image localization of the notification sound in steps S5 and S7 to the standard position, the sound image localization of the notification sound specified in step S1 is set to the standard position. This standard position is set to a place where it is not felt that only the notification sound has a characteristic localization when the content playback sound or the like is played at the same time as the front of the driver.

Then, in the notification sound reproduction process in step S8, the notification sound is reproduced based on the set sound image localization.

Although one embodiment has been described above, there are the following as other examples. Equipped with a microphone for measuring the noise level inside the vehicle, the volume level of the notification sound can be adjusted according to various noise levels such as speaking voice, content playback sound, running sound, and noise leaking from the outside of the vehicle. It may be changed. For example, when the amount of noise in the vehicle interior is small, the notification sound is output at a low volume level, and when the amount of noise in the vehicle interior is large, the notification sound is output at a high volume level.

By outputting the notification sound according to the noise environment in this way, when the sound image localization of the notification sound is the standard position, the driver can hear the notification sound without a sense of discomfort, and the sound image of the notification sound. When the localization is a specific position, the driver can more easily recognize the notification sound.

In the above embodiment, the sound image localization of the notification sound when the importance of the notification sound is high or the sensitivity to the notification sound is low in the importance is set as the ear, but the sound image localization is not limited to the ear, and the specific position is not limited to the ear. The position may be easily noticed by the driver. For example, the position of the sound image localization of the reproduced sound of the content being played in the vehicle interior is acquired in real time, and the position of the sound image localization of the reproduced sound of the content is separated from the position of the sound image localization of the notification sound to be noticed. The sound image localization of the notification sound may be controlled so as to be the position. As a result, for example, the notification sound can be heard from a position different from the playback sound of the content being viewed, and the driver can easily recognize the notification sound. In order to acquire the position of the sound image localization of the reproduced sound of the above content in real time, for example, the phase and volume of the sound data of the content, etc. are analyzed, and if the information is included in the content, the information is used. You can use it.

Further, in the above embodiment, the sound image localization of the notification sound when the importance of the notification sound is high or when the sensitivity to the notification sound is low in the importance is set as a specific position for the driver, but is limited to the driver. Instead, it may be a specific position with respect to at least one of the passengers of the vehicle including the passenger. In this case, the same processing as in the above-described embodiment may be performed on the passenger based on the output of the biosensor for the passenger and the image of the in-vehicle camera that captures the passenger.

The present invention is not limited to the above examples. That is, those skilled in the art can carry out various modifications according to conventionally known knowledge within a range that does not deviate from the gist of the present invention. As long as the configuration of the sound output device of the present invention is still provided by such a modification, it is, of course, included in the category of the present invention.

1 Control unit 2 Storage device 3 Sound source device 4 Sound system 5 Input system

Claims (10)

The notification sound information acquisition unit that acquires information about the notification sound to the passengers of the moving object,
A sound sensitivity estimation unit that estimates the sensitivity of the passenger regarding sound recognition, and a sound sensitivity estimation unit.
A sound image localization control unit that changes the sound image localization of the notification sound to the passenger based on the sensitivity estimated by the sound sensitivity estimation unit is provided.
When the sensitivity of the passenger regarding sound recognition is low, the sound image localization control unit brings the sound image localization closer to a specific position of the passenger than when the sensitivity is high. Output device. The notification sound information acquisition unit that acquires information about the notification sound to the passengers of the moving object,
A sound sensitivity estimation unit that estimates the sensitivity of the passenger regarding sound recognition, and a sound sensitivity estimation unit.
A sound image localization control unit that changes the sound image localization of the notification sound to the passenger based on the sensitivity estimated by the sound sensitivity estimation unit is provided.
An importance determination unit for determining the importance of the notification sound based on the type information of the notification sound acquired by the notification sound information acquisition unit as information related to the notification sound is provided.
The sound image localization control unit is a sound output device characterized in that the sound image localization is changed according to the sensitivity and the importance. It is provided with an operation control information acquisition unit that acquires operation control information related to the operation control of the moving body.
The sound output device according to claim 2 , wherein the sound image localization control unit changes the sound image localization according to the operation control information, the sensitivity, and the importance. The sound image localization control unit, said if it is determined that the high importance by importance degree determination unit, irrespective of the sensitivity, claim 2 the sound image localization, characterized in that the specific position of the occupant Or the sound output device according to 3. Any one of claims 1 to 4, wherein the sound sensitivity estimation unit estimates the sensitivity of the occupant with respect to sound recognition based on the occupant state information including the occupant's biological information. The sound output device described in. The sound output device according to claim 5 , wherein the sound sensitivity estimation unit detects the arousal level and / or the driving concentration level of the occupant as the occupant state information. The notification sound information acquisition unit that acquires information about the notification sound to the passengers of the moving object,
A sound sensitivity estimation unit that estimates the sensitivity of the passenger regarding sound recognition, and a sound sensitivity estimation unit.
A sound image localization control unit that changes the sound image localization of the notification sound to the passenger based on the sensitivity estimated by the sound sensitivity estimation unit is provided.
The mobile body state detection unit for detecting the mobile body state including the state related to the sound in the moving body is provided.
The sound sensitivity estimation unit is a sound output device that estimates the sensitivity of the passenger regarding sound recognition based on the moving body state detected by the moving body state detecting unit. The sound output device according to claim 7 , wherein the moving body state detecting unit detects a state related to a sound reproduced by the content reproducing device in the moving body as the moving body state. The notification sound information acquisition process for acquiring information on the notification sound to the passengers of the moving object, and
The sound sensitivity estimation process for estimating the sensitivity of the passenger regarding sound recognition, and
A sound image localization control step of changing the sound image localization of the notification sound to the passenger based on the sensitivity estimated in the sound sensitivity estimation step, and a sound image localization control step.
Only including,
The sound image localization control step is characterized in that when the sensitivity of the passenger regarding sound recognition is low, the sound image localization is brought closer to the specific position of the passenger than when the sensitivity is high. Sound output method. A sound output program characterized in that the sound output method according to claim 9 is executed by a computer.

Images