JP2019016971A - Sound output device - Google Patents

Abstract

To provide a sound output device capable of outputting appropriate notification sound according to the situation to a passenger of a moving body.SOLUTION: A driver monitoring unit estimates the awakening degree of a passenger, the driving concentration degree, and the like. by using a heartbeat sensor, an in-car camera, and the like. An informing sound image localization control unit determines the importance of the informing sound from the type of the informing sound and the vehicle state information. Also, on the basis of the vehicle state information, the awakening degree, and the driving concentration level, the sensitivity of the passenger to the informing sound is determined. Also, the sound image localization of the informing sound is controlled according to the sensitivity to the informing sound. An informing sound output unit is composed of a sound source device such as a DSP and an acoustic system such as a plurality of speakers and outputs an informing sound and sets the sound image localization of the informing sound at a specific position such as a passenger's ear or the like.SELECTED DRAWING: Figure 2

Description

  The present invention relates to a sound output device that outputs a notification sound to a passenger of a moving body.

  Conventionally, what outputs a notification sound to a driver of a vehicle is disclosed in, for example, Japanese Patent Application Laid-Open No. 2010-208606 (Patent Document 1). In this prior art, when an obstacle is detected, the sound image localization of the notification sound (notification sound) that informs the presence of the obstacle is localized in the detected direction so that the driver can recognize it.

JP 2010-208606 A

  In the conventional technology, for example, the sound image localization of the notification sound is uniquely performed regardless of the control state of the vehicle, such as automatic driving or manual driving, and the driver's state such as whether the driver is concentrating on driving or awakening. Therefore, depending on the situation, a notification sound that makes the driver feel bothersome may be output.

  It is an object of the present invention to provide a sound output device that can output an appropriate notification sound according to a situation to a passenger of a moving body.

In order to solve the above-mentioned problem, the invention described in claim 1 is a notification sound information acquisition unit that acquires information related to a notification sound to a passenger of a moving body, and a sound that estimates a sensitivity related to the sound recognition of the passenger. A sensitivity estimation unit; and a sound image localization control unit that changes the sound image localization of the notification sound to the passenger based on the sensitivity estimated by the sound sensitivity estimation unit;
A sound output device comprising:

  Further, the invention according to claim 10 is a notification sound information acquisition step of acquiring information related to a notification sound to a passenger of a moving body, a sound sensitivity estimation step of estimating a sensitivity related to the sound recognition of the passenger, And a sound image localization control step of changing a sound image localization of the notification sound to the passenger based on the sensitivity estimated by the sound sensitivity estimation unit.

  The invention described in claim 11 is a sound output program characterized by causing a computer to execute the sound output method described in claim 10.

It is a schematic block diagram of the sound output device of one Example of this invention. It is a functional block diagram of the sound output device of one Example of this invention. The program which the computer of the sound output device of one Example of this invention runs is a flowchart.

  Hereinafter, a sound output device according to an embodiment of the present invention will be described. A sound output device according to an embodiment of the present invention includes a notification sound information acquisition unit that acquires information related to a notification sound to a passenger of a moving body, a sound sensitivity estimation unit that estimates sensitivity regarding sound recognition of the passenger, A sound image localization control unit that changes the sound image localization of the notification sound to the passenger based on the sensitivity estimated by the sound sensitivity estimation unit. Therefore, an appropriate notification sound can be output with sound image localization corresponding to the sensitivity of the passenger regarding sound recognition.

  In addition, the sound sensitivity estimation unit estimates sensitivity related to the passenger's sound recognition based on passenger state information including the biological information of the passenger. The occupant status information includes, for example, the occupant's heart rate, blinking frequency, yawning frequency, driving concentration, etc., and can output a notification sound with sound image localization suitable for the occupant's status.

  A moving body state detection unit that detects a moving body state including a state relating to sound in the moving body, wherein the sound sensitivity estimation unit is configured to perform the operation based on the moving body state detected by the moving body state detection unit; Estimate the sensitivity of passengers to sound recognition. The moving body information is, for example, the state of content reproduction sound in the vehicle, and can output a notification sound with sound image localization suitable for the state of the vehicle.

  The sound image localization control unit brings the sound image localization closer to the specific position of the occupant when the sensitivity regarding the sound recognition of the occupant is low than when the sensitivity is high. The specific position is, for example, the passenger's ear or overhead, and the notification sound can be output to a specific position that is rarely experienced.

  The notification sound information acquisition unit includes an importance determination unit that determines the importance of the notification sound based on the type information of the notification sound acquired as information about the notification sound, and the sound image localization control unit includes: The sound image localization is changed according to the sensitivity and the importance. Thereby, a notification sound can be output with sound image localization corresponding to the importance of the notification sound.

  In addition, an operation control information acquisition unit that acquires operation control information related to operation control of the mobile body is provided, and the sound image localization control unit changes the sound image localization according to the operation control information, the sensitivity, and the importance. Let The driving control information is information indicating the control state of the vehicle, such as whether the vehicle is automatic driving or manual driving, and can output a notification sound with sound image localization suitable for the vehicle state.

  The sound image localization control unit sets the sound image localization to a specific position of the occupant regardless of the sensitivity when the importance determination unit determines that the importance is high. Thereby, a notification sound can be output with sound image localization corresponding to the importance of the notification sound.

  Further, the sound sensitivity estimation unit detects the wakefulness level and / or driving concentration level of the occupant as the occupant state information.

  Moreover, the said mobile body state detection part detects the state regarding the sound which the content reproduction apparatus in the said mobile body reproduces as the said mobile body state.

  The sound output method according to an embodiment of the present invention includes a notification sound information acquisition step of acquiring information related to a notification sound to a passenger of a moving body, and a sound sensitivity estimation that estimates sensitivity related to the sound recognition of the passenger. And a sound image localization control step of changing a sound image localization of the notification sound to the passenger based on the sensitivity estimated by the sound sensitivity estimation unit.

  Moreover, it is good also as a sound output program which performs the sound output method mentioned above by computer.

  A sound output device according to an embodiment of the present invention will be described with reference to FIGS.

  FIG. 1 is a schematic configuration diagram of a sound output device according to an embodiment of the present invention, and FIG. 2 is a functional block diagram of the sound output device according to the embodiment.

  As shown in FIG. 1, the sound output device of the embodiment is mounted on a vehicle and is operated by a computer or the like, a control unit 1, a storage device 2 storing a sound output program or the like of the embodiment of the present invention, a DPS, or the like Input for inputting a sound source device 3 for outputting an acoustic signal, an acoustic system 4 including a plurality of speakers, various data from a navigation device, biological information from a biological sensor (pulse sensor, etc.), image data from an in-vehicle camera, etc. A system 5 is provided.

  In the functional block diagram of FIG. 2, the navigation unit outputs, for example, a navigation guidance sound for guiding a driving route. The driving support information output unit outputs information on the vehicle's braking notice (eg, “move to the right lane”, “emergency stop”, etc.) during automatic driving, and during manual driving, the driving lane information Outputs information on safe driving support such as departure warning and inter-vehicle distance warning. The “notification sound source information” includes navigation guidance sound from the navigation unit, notification sound such as braking warning sound and danger warning sound from the driving support information output unit, and type information indicating the type of the notification sound. This information is input to the notification sound image localization control unit.

  In the functional block diagram of FIG. 2, the automatic operation control unit automatically controls all or part of the acceleration / steering / braking operation. More specifically, in automatic driving, automatic control among acceleration, steering, and braking differs depending on the automatic driving level. The automatic driving control unit outputs information indicating whether automatic driving or manual driving, information indicating the control state of the vehicle according to the automatic driving level, and the like. The content playback unit has the following functions. For example, content playback here refers to playback of package media such as CD and DVD, playback of broadcast content such as television and radio, playback of content acquired by wireless communication, etc. For example, audio playback. The content reproduction unit outputs the content information being reproduced. The “vehicle state information” is information such as information output from the automatic driving control unit, content information output from the content playback unit when the content playback unit is playing back, and the information is a notification sound. The sound is input to the sound image localization control unit.

  The “driver monitoring unit” estimates a driver's arousal level, driving concentration level, and the like using a heart rate sensor, an in-vehicle camera, and the like, and outputs information indicating the estimated state. The driver's arousal level is determined by a decrease in heart rate, blinking frequency, yawning frequency, or the like. Driving concentration is determined by the frequency of looking aside. Information indicating these estimated states is input to the notification sound image localization control unit.

  The “notification sound image localization control unit” includes a “notification sound importance level determination unit”, a “sensitivity determination unit”, and a “sound image localization control unit”. The “notification sound importance level determination unit” determines the importance level of the notification sound from the type of the notification sound included in the notification sound source information and the vehicle state information. The “sensitivity determination unit” determines the sensitivity of the driver to the notification sound based on the vehicle state information, the arousal level, and the driving concentration level. The “sound image localization control unit” controls the sound image localization of the notification sound according to the sensitivity to the determined notification sound.

  The “notification sound output unit” includes a sound source device 3 made of a DSP or the like and an acoustic system 4 such as a plurality of speakers. The notification sound output unit changes the direction and distance of the sound source of the notification sound by the driver (sound image localization of the notification sound) based on control by the sound image localization control unit. In other words, the notification sound output unit processes and outputs the notification sound so that the position of the virtual sound source of the notification sound changes based on the control by the sound image localization control unit.

  FIG. 3 is a flowchart of the sound output program executed by the computer in the control unit 1 of the sound output apparatus of the embodiment. This flowchart is a main part flowchart of the control program executed by the computer (the CPU) of the control unit 1, and is configured as a subroutine for the main process of the control program.

  First, sound reproduction instruction processing is executed in step S1. In step S1, a notification sound reproduction instruction output from the navigation unit and the driving support information output unit and information on the type of the notification sound are received, and the process proceeds to step S2. In the sound importance level determination process in step S2, the importance level of the notification sound that is instructed to be reproduced in step S1 is determined based on the type of the received notification sound (for example, navigation guidance sound, braking warning sound, danger warning sound, etc.), and At this time, the vehicle control state (automatic operation / manual operation or automatic operation level) acquired from the automatic operation control unit is determined.

  In the importance level determination process, for example, the importance level of the notification sound is set as follows. The state of low importance is the case of a notification sound (such as navigation guidance voice during automatic driving) that has little effect even if the driver misses it. Further, the state of medium importance is a case of a notification sound (for example, navigation guidance voice during manual driving, lane change notification during automatic driving, etc.) that does not suddenly change the control of the vehicle. Further, the state of high importance is a case of a notification sound (for example, a sudden brake notification during automatic driving, an obstacle warning during manual driving, a lane departure warning, etc.) that causes a sudden change in vehicle control. Or you may make it determine the importance for every classification | category of a notification sound according to the level of automatic driving | operation. If the importance level is medium, the process proceeds to step S3. If the importance level is high, the process proceeds to step S6. If the importance level is low, the process proceeds to step S7.

  In the sound sensitivity determination process in step S3, the driver's sensitivity to the notification sound for which a reproduction instruction has been issued is determined. This sensitivity is determined from the playback state of other sound sources (for example, the playback sound of the content being played back) at this time, the driver's arousal level estimated by the driver monitoring unit, the driver's driving concentration level, and the like. For example, with regard to the playback state of other sound sources, “NG” when playing, “OK” when playback is stopped, “NG” when the driver is low, “NG” when the driver is low, and “NG” when the driver is high. “OK” and the driving concentration are evaluated for each element such as “NG” if the driving concentration of the driver is low and “OK” if the driving concentration of the driver is high. Among the above three elements, if there is at least one “NG”, the sensitivity of the driver is “low”, and if all are “OK”, the sensitivity of the driver is “high”. The above determination condition is an example, and may be set as appropriate. For example, if there are two or more “OK”, the sensitivity may be determined as “high”.

  When the sensitivity is low, a process of setting the sound image localization of the notification sound at the ear (specific position) is performed at step S4, and when the sensitivity is high, a process of setting the sound image localization of the notification sound at the standard position at step S5. And proceed to step S8.

  On the other hand, when it is determined in step S2 that the importance level is high and the process proceeds to step S6, a process of setting the sound image localization of the notification sound at the ear is performed in step S6, and the process proceeds to step S8. If it is determined in step S2 that the degree of importance is low and the process proceeds to step S7, processing for setting the sound image localization of the notification sound to the standard position is performed in step S7, and the process proceeds to step S8.

  Here, in the process of setting the sound image localization of the notification sound in step S4 and step S6 to the ear, the sound image localization of the notification sound specified in step S1 is set to be heard at the driver's ear. Note that the position of the ear is an example of a “specific position”, and the “specific position” is not limited to the ear, but may be localized at a specific position (for example, overhead). Thus, the notification sound can be heard from a unique position that is rarely experienced, and the driver can easily recognize the notification sound. Sound image localization can be controlled in real time (for example, processing by a DSP), or a plurality of sound sources that have the same original sound source but different localization locations are prepared in advance, and which sound source is played back in a timely manner. May be selected.

  In the process of setting the sound image localization of the notification sound in step S5 and step S7 to the standard position, the sound image localization of the notification sound specified in step S1 is set to the standard position. This standard position is assumed to be a place where only the notification sound does not feel that the localization is characteristic when it is made at the same time as the content reproduction sound, for example, in front of the driver.

  In the notification sound reproduction process in step S8, the notification sound is reproduced based on the set sound image localization.

  Although one embodiment has been described above, other embodiments include the following. It is further equipped with a microphone to measure the noise level in the passenger compartment, and the volume level of the notification sound can be adjusted according to various noise levels such as talking voice, content playback sound, running sound, and noise leaking from outside the vehicle. It may be changed. For example, when the amount of noise in the passenger compartment is small, the notification sound is output at a low volume level, and when the amount of noise in the passenger compartment is large, the notification sound is output at a high volume level.

  Thus, when the notification sound corresponding to the noise environment is output, when the sound image localization of the notification sound is the standard position, the driver can hear the notification sound without any sense of incongruity, and the sound image of the notification sound When the localization is a specific position, it becomes easier for the driver to recognize the notification sound.

  In the above embodiment, the sound image localization of the notification sound when the importance of the notification sound is high or when the sensitivity to the notification sound is low in importance is not limited to the ear, and the specific position is as the specific position. The position may be easily noticed by the driver. For example, the position of the sound image localization of the reproduction sound of the content being played in the passenger compartment is acquired in real time, and the position of the sound image localization of the reproduction sound of the content is separated from the position of the sound image localization of the notification sound to be noticed The sound image localization of the notification sound may be controlled so as to be the position. Accordingly, for example, the notification sound can be heard from a position different from the reproduction sound of the content being viewed, and the driver can easily recognize the notification sound. In addition, in order to obtain the position of the sound image localization of the playback sound of the above content in real time, for example, the phase or volume of the sound data of the content is analyzed, or if the information is included in the content, the information is used. You can use it.

  Further, in the above embodiment, the sound image localization of the notification sound when the importance level of the notification sound is high or when the importance level is low and the sensitivity to the notification sound is low is set as the specific position for the driver, but is limited to the driver. It is good also as a specific position with respect to at least any one of the passengers of vehicles including a fellow passenger. In this case, the same processing as in the above-described embodiment may be performed on the passenger based on the output of the biosensor for the passenger and the image of the in-vehicle camera that captures the passenger.

  The present invention is not limited to the above embodiments. That is, those skilled in the art can implement various modifications in accordance with conventionally known knowledge without departing from the scope of the present invention. Of course, such modifications are included in the scope of the present invention as long as they have the configuration of the sound output device of the present invention.

DESCRIPTION OF SYMBOLS 1 Control part 2 Memory | storage device 3 Sound source device 4 Sound system 5 Input system

Claims (11)

A notification sound information acquisition unit for acquiring information related to a notification sound to a passenger of the moving body;
A sound sensitivity estimator for estimating the sensitivity of the passenger regarding sound recognition;
A sound image localization control unit that changes the sound image localization of the notification sound to the passenger based on the sensitivity estimated by the sound sensitivity estimation unit;
A sound output device comprising:   The sound output device according to claim 1, wherein the sound sensitivity estimation unit estimates sensitivity related to sound recognition of the passenger based on passenger state information including the biological information of the passenger. A moving body state detecting unit for detecting a moving body state including a state relating to sound in the moving body;
The sound output device according to claim 1, wherein the sound sensitivity estimation unit estimates sensitivity related to sound recognition of the occupant based on the moving body state detected by the moving body state detection unit.   4. The sound image localization control unit according to claim 2, wherein the sound image localization control unit brings the sound image localization closer to a specific position of the passenger when the sensitivity of the passenger regarding sound recognition is low than when the sensitivity is high. The sound output device described in 1. Based on the type information of the notification sound acquired by the notification sound information acquisition unit as information related to the notification sound, an importance level determination unit that determines the importance level of the notification sound,
The sound output device according to any one of claims 1 to 4, wherein the sound image localization control unit changes the sound image localization according to the sensitivity and the importance. An operation control information acquisition unit that acquires operation control information related to the operation control of the mobile body is provided,
The sound output device according to claim 5, wherein the sound image localization control unit changes the sound image localization according to the operation control information, the sensitivity, and the importance.   The sound image localization control unit sets the sound image localization to a specific position of the occupant regardless of the sensitivity when the importance level determination unit determines that the level of importance is high. Or the sound output device of 6.   The sound output device according to any one of claims 1 to 5, wherein the sound sensitivity estimation unit detects the wakefulness level and / or driving concentration level of the occupant as the occupant state information.   The sound according to any one of claims 3 to 8, wherein the moving body state detection unit detects a state relating to a sound reproduced by a content reproduction device in the moving body as the moving body state. Output device. A notification sound information acquisition step of acquiring information related to a notification sound to a passenger of the moving body;
A sound sensitivity estimation step of estimating the sensitivity of the passenger regarding sound recognition;
A sound image localization control step of changing the sound image localization of the notification sound to the passenger based on the sensitivity estimated by the sound sensitivity estimation unit;
A sound output method comprising:   A sound output program that causes a computer to execute the sound output method according to claim 10.

Images