WO2018173112A1 - Sound output control device, sound output control system, and sound output control method - Google Patents

Abstract

The present invention comprises an estimation unit (10) that estimates in-vehicle atmosphere for each of a plurality of occupants in a vehicle (200) and a control unit (11) that controls sound output for each occupant on the basis of the in-vehicle atmosphere for each occupant estimated by the estimation unit (10).

Description

Sound output control device, sound output control system, and sound output control method

The present invention relates to a sound output control device, a sound output control system, and a sound output control method for controlling sound output to each of a plurality of occupants of a vehicle.

Conventionally, there has been proposed a technique for estimating the occupant situation from the atmosphere inside the vehicle and providing information corresponding to the occupant situation. For example, in the vehicle information providing apparatus described in Patent Document 1, the presence or absence of a conversation, if there is a conversation, laughing voice, angry voice, words spoken by the occupant, the passenger's atmosphere, etc. are estimated, Furthermore, the situation of the driver is estimated from the atmosphere in the vehicle.

JP 2008-90509 A

In the conventional technique represented by Patent Document 1, since the overall atmosphere in the vehicle is estimated, there is a problem that the sound output cannot be controlled with a sound volume suitable for each occupant.
An example is given in which the driver and the passenger in the rear seat are talking through the in-car call using the vehicle-mounted microphone and the vehicle-mounted speaker, but the passenger in the passenger seat is sleeping.
In this case, the vehicular information providing apparatus described in Patent Document 1 detects the laughing voice generated by the driver even when the passenger in the passenger seat is sleeping, and the conversation between the two is excited and the atmosphere in the vehicle is active. Presume that there is.
When the in-vehicle speakers are controlled to assist the conversation between the two based on the estimation result, the volume of the in-vehicle speaker on the driver's side and the volume of the in-vehicle speaker on the rear seat side are made easier to hear both utterances. Are raised together. For this reason, there is a possibility that the passenger in the passenger seat may be disturbed by the speech of both.

Moreover, although the driver and the occupant in the rear seat are talking through the in-car call, a case where the driver does not actively participate in the conversation while concentrating on driving is given as an example.
In this case, in the vehicular information providing apparatus described in Patent Document 1, even if the driver is not actively participating in the conversation, if the laughter or the like uttered by the passenger in the rear seat is detected, the conversation between the two is excited. It is estimated that the atmosphere in the car is active.
When the in-vehicle speaker is controlled to assist both conversations based on this estimation result, the driver is not actively participating in the conversation, but in order to make it easier to hear the utterance voice of the passenger in the rear seat, The volume of the in-vehicle speaker on the driver's seat side is increased. As a result, the driver feels annoying the output sound of the vehicle-mounted speaker.

This invention solves the said subject, and aims at obtaining the sound output control apparatus, sound output control system, and sound output control method which can output a sound with the sound volume suitable for every passenger | crew of a vehicle.

The sound output control device according to the present invention is configured to estimate an atmosphere in each of a plurality of occupants of a vehicle, and the sound output for each occupant based on the atmosphere in the vehicle for each occupant estimated by the estimation unit. A control unit for controlling.

According to the present invention, since sound output is controlled for each occupant based on the estimated atmosphere in the vehicle for each occupant, it is possible to output sound at a volume suitable for each occupant of the vehicle.

It is a block diagram which shows the structure of the sound output control system which concerns on Embodiment 1 of this invention. FIG. 2A is a block diagram showing a hardware configuration for realizing the function of the sound output control system according to Embodiment 1. FIG. 2B is a block diagram illustrating a hardware configuration for executing software that implements the functions of the sound output control system according to Embodiment 1. 3 is a flowchart illustrating a sound output control method according to the first embodiment. 1 is a block diagram showing a configuration of a sound output control device according to Embodiment 1. FIG. 3 is a flowchart illustrating an operation of an estimation unit according to Embodiment 1. It is a figure which shows the example of arrangement | positioning of the sound output control system which concerns on Embodiment 1. FIG. It is a figure which shows the other example of arrangement | positioning of the sound output control system which concerns on Embodiment 1. FIG. It is a flowchart which shows the telephone call process by a portable terminal. 4 is a flowchart showing a sound output control process of the mobile terminal by the sound output control device according to the first embodiment. It is a block diagram which shows the structure of the sound output control apparatus which concerns on Embodiment 2 of this invention. 10 is a flowchart illustrating an operation of an estimation unit according to the second embodiment. It is a block diagram which shows the structure of the sound output control apparatus which concerns on Embodiment 3 of this invention. 10 is a flowchart illustrating an operation of a control unit in the third embodiment. It is a figure which shows the example of arrangement | positioning of the sound output control system which concerns on Embodiment 4 of this invention. It is a flowchart which shows the control processing of the sound output in the in-vehicle call performed by 1 to several passenger | crew. It is a figure which shows the other example of arrangement | positioning of the sound output control system which concerns on Embodiment 4 of this invention. It is a flowchart which shows the control process of the sound output in the in-vehicle call performed between passengers of 1: 1.

Hereinafter, in order to describe the present invention in more detail, modes for carrying out the present invention will be described with reference to the accompanying drawings.
Embodiment 1 FIG.
FIG. 1 is a block diagram showing the configuration of a sound output control system 1 according to Embodiment 1 of the present invention. The sound output control system 1 is a system that controls sound output for each occupant of a vehicle, and controls sound output in in-car calls or media playback performed between occupants.
The sound output control device 2 is a device that controls the sound output of the sound output devices 3a to 3d. Each of the sound input devices 4a to 4d, the portable terminal 5, the vehicle information acquisition unit 6, the storage unit 7, and the photographing device 8 is provided. You can get information from. Moreover, the sound output control apparatus 2 is provided with the arithmetic processing part 9, the estimation part 10 contained in the arithmetic processing part 9, and the control part 11 as a function structure.

The sound output devices 3a to 3d are, for example, in-vehicle speakers arranged for each seat in the vehicle, and convert the sound signal, which is an electrical signal, into sound and output it. The sound signal of the output sound is converted into an analog signal by the signal converter 12a, amplified by the signal amplifier 13a, and then output from each of the sound output devices 3a to 3d.

The sound input devices 4a to 4d are, for example, in-vehicle microphones arranged for each seat in the vehicle, and convert the input sound into a sound signal. The sound signals converted by the sound input devices 4a to 4d are amplified by the signal amplification unit 13b, converted into digital signals by the signal conversion unit 12a, and then input to the arithmetic processing unit 9.

The mobile terminal 5 is a communication terminal such as a smart phone, a mobile phone, or a tablet PC, and can communicate with the sound output control device 2 to output the above-mentioned in-car call or media playback sound. Note that the sound output control device 2 also controls the sound output of a speaker included in the mobile terminal 5.
The portable terminal 5 communicates with the sound output control device 2 through the communication I / F unit 14.
Examples of a communication method for the mobile terminal 5 to communicate with the sound output control device 2 include short-range wireless communication such as Bluetooth (registered trademark, the description is omitted below).

The vehicle information acquisition unit 6 acquires information on the state of the vehicle and the driving operation of the vehicle (hereinafter referred to as vehicle information). The vehicle information includes, for example, window opening / closing degree, engine speed, vehicle speed, accelerator opening, and vehicle position information. As a vehicle information acquisition method, it is conceivable that the vehicle information is acquired from an ECU (Electronic Control Unit) through an in-vehicle network. Moreover, the vehicle information acquisition part 6 may calculate vehicle information based on the information acquired from the vehicle side. For example, the vehicle speed may be a value calculated from a pulse signal output according to the rotation of the wheel.

The storage unit 7 stores sound output history information for each vehicle occupant. In the sound output history information, the output volume set in the sound output device is registered for each occupant and each sound source. The sound output history information is stored in the storage unit 7 in association with the estimation information of the atmosphere in the vehicle when the output volume is set to the sound output device. The history information may be stored in the storage unit 7 in association with vehicle interior noise when the output volume is set to the sound output device.

The sound output history information is automatically created by the control unit 11 and stored in the storage unit 7.
For example, when the volume is manually set by the occupant, the control unit 11 creates history information on the assumption that the volume is the optimum volume for the occupant, and the occupant's interior atmosphere, in-vehicle noise, The information is stored in the storage unit 7 in association with the identification information.
If the volume is not set by the occupant, the control unit 11 creates history information on the assumption that the volume previously set according to the sound output device is the optimal volume for the occupant, and the atmosphere in the passenger's vehicle at this time Are stored in the storage unit 7 in association with vehicle interior noise and occupant identification information.

The photographing device 8 is a camera provided in the vehicle, and photographs the state inside the vehicle including the occupant. An image including an occupant's face cut out from an image photographed by the photographing device 8 is used for personal authentication, but the image may be used for estimation of the atmosphere in the vehicle.
Image information photographed by the photographing device 8 is converted into an image signal by the signal conversion unit 12 c and output to the estimation unit 10 and the control unit 11.

The arithmetic processing unit 9 performs arithmetic processing related to sound output. For example, arithmetic processing such as echo cancellation and noise cancellation is performed. The arithmetic processing unit 9 includes an estimation unit 10.
The estimation unit 10 estimates the atmosphere in each of a plurality of occupants of the vehicle.
The control unit 11 controls the sound output of the sound output devices 3a to 3d for each occupant based on the atmosphere in the vehicle for each occupant estimated by the estimation unit 10.
Although the estimation part 10 and the control part 11 are the structures with which one sound output control apparatus 2 is provided, the estimation part 10 and the control part 11 may be provided in a separate apparatus. In this case, both apparatuses have a communication function capable of exchanging data with each other.

FIG. 2A is a block diagram illustrating a hardware configuration for realizing the function of the sound output control system 1 according to Embodiment 1. FIG. 2B is a block diagram illustrating a hardware configuration that executes software that implements the functions of the sound output control system 1 according to the first embodiment.
2A and 2B, a signal I / F 100 is the signal conversion unit 12a and the signal amplification unit 13a illustrated in FIG. The in-vehicle speaker 101 is the sound output device 3a to 3d shown in FIG. The signal I / F 102 is the signal conversion unit 12b and the signal amplification unit 13b illustrated in FIG. The in-vehicle microphone 103 is the sound input devices 4a to 4d shown in FIG. The communication I / F 104 is the communication I / F unit 14 shown in FIG. The signal I / F 105 is the signal converter 12c shown in FIG. The storage device 106 is the storage unit 7 shown in FIG.

Each function of the estimation unit 10 and the control unit 11 in the sound output control device 2 is realized by a processing circuit. That is, the sound output control device 2 includes a processing circuit for executing the processes of step ST1 and step ST2 shown in FIG. The processing circuit may be dedicated hardware or a CPU (Central Processing Unit) that executes a program stored in the memory.

When the processing circuit is the dedicated hardware shown in FIG. 2A, the processing circuit 107 includes, for example, a single circuit, a composite circuit, a programmed processor, a parallel programmed processor, an ASIC (Application Specific Integrated Circuit), FPGA ( Field-Programmable Gate Array) or a combination thereof. The function of the estimation unit 10 and the function of the control unit 11 may be realized by separate processing circuits, or these functions may be realized by a single processing circuit.

When the processing circuit is the CPU 108 shown in FIG. 2B, the functions of the estimation unit 10 and the control unit 11 are realized by software, firmware, or a combination of software and firmware. Software or firmware is described as a program and stored in the memory 109.
The CPU 108 reads out and executes the program stored in the memory 109, thereby realizing the functions of the respective units. That is, the sound output control device 2 includes a memory 109 for storing a program that, when executed by the CPU 108, results in the process of step ST1 and the process of step ST2 shown in FIG.
These programs cause a computer to execute the procedures or methods of the estimation unit 10 and the control unit 11.

The memory 109 may be, for example, a nonvolatile memory such as a RAM (Random Access Memory), a ROM (Read Only Memory), a flash memory, an EPROM (Erasable Programmable Read Only Memory), an EEPROM (Electrically-EPROM), or a volatile memory. Magnetic disks, flexible disks, optical disks, compact disks, mini disks, DVDs, and the like are applicable.

Note that a part of each function of the estimation unit 10 and the control unit 11 may be realized by dedicated hardware, and a part may be realized by software or firmware.
For example, the function of the estimation unit 10 is realized by a processing circuit as dedicated hardware, and the function of the control unit 11 is realized by the CPU 108 reading and executing a program stored in the memory 109. Also good.
Thus, the processing circuit can realize each of the above functions by hardware, software, firmware, or a combination thereof.

Next, the operation will be described.
FIG. 3 is a flowchart showing the sound output control method according to Embodiment 1, and shows a series of processes for controlling the sound output for each occupant based on the atmosphere in the vehicle for each occupant.
First, the estimation unit 10 estimates the atmosphere in the vehicle for each occupant (step ST1).
Next, the control unit 11 controls the sound output of the sound output devices 3a to 3d for each occupant based on the atmosphere in the vehicle for each occupant (step ST2). Thereby, since the sound output is controlled for each occupant based on the atmosphere in the vehicle for each occupant, the sound can be output at a volume suitable for each occupant of the vehicle.

Next, the functional configuration of the estimation unit 10 will be described.
FIG. 4 is a block diagram showing the configuration of the sound output control device 2 according to Embodiment 1, and shows only the configuration for controlling the sound output. As illustrated in FIG. 4, the estimation unit 10 includes an acquisition unit 15, an analysis unit 16, and an atmosphere estimation unit 17.
The acquisition part 15 acquires the passenger | crew information used for estimation of the atmosphere in a vehicle for every passenger | crew. For example, the acquisition unit 15 acquires an input sound signal as occupant information from the sound input devices 4a to 4d provided for each seat where an occupant sits in the vehicle.

The analysis unit 16 analyzes the occupant information acquired by the acquisition unit 15 and obtains information serving as a reference for estimating the atmosphere in the vehicle. For example, the analysis unit 16 acoustically analyzes an occupant's sound signal to obtain one of conversation content, voice tone, and utterance frequency.

The atmosphere estimation unit 17 estimates the atmosphere in the vehicle for each occupant based on the analysis result of the analysis unit 16. For example, the atmosphere estimation unit 17 estimates the atmosphere in the vehicle for each occupant from the sound signal for each occupant based on the content of the conversation, the tone of the voice, and the utterance frequency.

The control unit 11 determines the output volume for each occupant based on the estimated atmosphere in the vehicle for each occupant, and controls the sound output devices 3a to 3d so as to output sound at the determined output volume.
For example, the output volume of a sound output device corresponding to an occupant who is active in conversation is increased, and the output volume of a sound output device corresponding to an occupant who is not active in conversation is decreased. Further, the volume of the sound output device corresponding to the sleeping passenger may be set to 0 (output stop).

In addition to the processing described above, the acquisition unit 15 may acquire in-vehicle image information captured by the imaging device 8. In this case, the analysis unit 16 performs image analysis on the image information in the vehicle to obtain either the facial expression or the gesture of the passenger. The atmosphere estimation unit 17 estimates the atmosphere in the vehicle for each occupant based on the facial expression and gesture of the occupant.
The atmosphere estimation unit 17 also estimates the atmosphere in the vehicle for each occupant based on the acoustic analysis results of the input sound signals acquired by the sound input devices 4a to 4d and the image analysis result of the image information in the vehicle. Good.

FIG. 5 is a flowchart showing the operation of the estimation unit 10 and shows the details of the processing corresponding to step ST1 of FIG. FIG. 6 is a diagram showing an arrangement example of the sound output control system 1 according to the first embodiment, and shows a case where the sound output control system 1 is arranged in the vehicle 200.
In the example shown in FIG. 6, the sound input device 4a is provided corresponding to the occupant A who is the driver, the sound input device 4b is provided corresponding to the occupant B of the front passenger seat, and the occupant C of the rear seat is provided. The sound input device 4c is provided, and the sound input device 4d is provided corresponding to the occupant D of the rear seat.
Hereinafter, the operation of the estimation unit 10 in the sound output control system 1 shown in FIG. 6 will be described.

The acquisition unit 15 acquires occupant information used for estimating the atmosphere in the vehicle for each occupant (step ST1a). For example, the acquisition unit 15 acquires sound signals input to the sound input devices 4a to 4d at all times during activation of the sound output control system 1 or periodically or always after an event that serves as a trigger occurs. . Thereby, the sound around the seat for each occupant or the uttered voice for each occupant is acquired as a sound signal. Examples of the event include an operation that starts sound generation such as an in-car call start operation and a media playback start operation.

Next, the analysis part 16 analyzes the passenger | crew information acquired by the acquisition part 15, and calculates | requires the information used as the estimation reference | standard of the atmosphere in the vehicle for every passenger | crew (step ST2a).
For example, the analysis unit 16 acoustically analyzes the sound signal to extract the utterance voice, recognizes the voice, and obtains the result of analyzing the presence / absence of a specific keyword as the content of the conversation for each occupant. The specific keyword is a keyword that serves as a reference indicating the degree of excitement between the passengers, and includes “interesting” and “not interested”.
The analysis unit 16 may acoustically analyze the sound signal to obtain the tone of the occupant's utterance voice, or may obtain the magnitude of the utterance voice.
Furthermore, the analysis unit 16 may count the number of times the utterance voice can be extracted by acoustic analysis of the sound signal for each occupant, and obtain the utterance frequency for each occupant from the number of counts.

The atmosphere estimation unit 17 estimates the atmosphere in the vehicle for each occupant based on the analysis result of the analysis unit 16 (step ST3a). For example, table data in which keywords and information indicating the atmosphere in the vehicle are associated is stored in the storage unit 7. The atmosphere estimation unit 17 estimates the atmosphere corresponding to the keyword extracted from the sound signal with reference to the table data read from the storage unit 7. If the passenger's voice includes the keyword “interesting”, the passenger is estimated to have a “fun” atmosphere. In addition, the atmosphere estimation unit 17 presumes that the utterance voice tone is higher than the threshold value and actively talks and assumes that the atmosphere is “fun”, and if the utterance voice tone is equal to or less than the threshold value, the atmosphere estimation unit 17 actively talks. It may be presumed that the atmosphere is “bottom”. Further, when the utterance frequency is equal to or lower than the threshold value, the atmosphere estimation unit 17 may determine that the occupant is not participating in the conversation or is sleeping, and may estimate that the atmosphere is “quiet”.

The acquisition unit 15 may acquire in-vehicle image information captured by the imaging device 8 in addition to or instead of the sound signals input to the sound input devices 4a to 4d. It is assumed that all the passengers in the vehicle are photographed in this image information.
When the image information in the vehicle is input from the acquisition unit 15, the analysis unit 16 analyzes the image information to extract an image area for each occupant, analyzes the occupant image area, analyzes the occupant's facial expressions, and gestures. Ask for either. For example, the facial expression of the occupant can be identified by comparing the occupant's face image analyzed from the image with the facial expression image pattern. It is possible to identify the occupant's gesture in the same way. The gestures identified here are the gestures that serve as the standard for estimating the occupant's aggressiveness with respect to conversations, such as “operating a smartphone” and “facing the face to the window”. Can be mentioned.
The atmosphere estimation unit 17 estimates the atmosphere corresponding to the facial expression and gesture specified from the image information with reference to the table data in which the facial expression and gesture and the information indicating the atmosphere are associated with each other. For example, if the facial expression is a smile, this occupant is presumed to be in a “fun” atmosphere, and if the expression is lying down, the occupant is presumed to be in a “dull” atmosphere.

Further, the atmosphere estimation unit 17 may estimate the final atmosphere of the occupant by considering the analysis result of the sound signal and the analysis result of the image information in a complementary manner. For example, if the utterance frequency is below the threshold but the facial expression is laughing, it is determined that the occupant is talking or playing media, not sleeping, and is presumed to have a “fun” atmosphere .

When the processing shown in FIG. 5 is completed, the control unit 11 determines the output volume for each occupant based on the atmosphere in the vehicle for each occupant estimated by the estimation unit 10, and outputs the sound with the determined output volume. Control the sound output device.
For example, the control unit 11 calculates the output volume of the sound output device for each occupant by multiplying the reference volume for each sound output device by the weight set for each atmosphere in the vehicle.
Further, table data in which the atmosphere in the vehicle and the volume of the sound output device are associated with each other is stored in the storage unit 7, and the control unit 11 refers to the table data read from the storage unit 7, for each occupant. The output volume of the sound output device may be selected.
Further, the control unit 11 corrects the output volume for each occupant obtained based on the atmosphere in the vehicle in consideration of the atmosphere in the vehicle for each passenger and the positional relationship between the passengers in the vehicle.
For example, when the volume of the sound output device corresponding to the occupant y seated next to the occupant x is increased, the increase is more asleep than when the occupant x is awake ("quiet" atmosphere) Is corrected to be smaller.

As an example of the in-vehicle situation A1, an occupant A in the driver's seat and an occupant D in the rear seat have a conversation by in-car call, an occupant B in the front passenger seat watches the in-car television, and an occupant C in the rear seat is asleep.
Moreover, although the passenger | crew D is talking actively, the passenger | crew A is the state which concentrates on driving | operation and is not talking actively. The passenger D who is active in the conversation is presumed to have a “fun” atmosphere, and the passenger A who is not active in the conversation is presumed to have a “dull” atmosphere.
Further, it is estimated that the passenger B watching the in-car television has a “fun” atmosphere, and the sleeping passenger C is estimated to have a “quiet” atmosphere.

In the in-vehicle situation A1, the control unit 11 decreases the output volume of the sound output device 3a corresponding to the passenger A who is estimated to have a “bottom” atmosphere. Further, the control unit 11 increases the output volume of the sound output device 3b corresponding to the occupant B estimated to be the “fun” atmosphere, and the output of the sound output device 3d corresponding to the occupant D estimated to be the “fun” atmosphere. Increase the volume. Further, the control unit 11 sets the output volume of the sound output device 3c corresponding to the occupant C estimated to be a “quiet” atmosphere to 0 (output stop).
Since the occupant D is adjacent to the occupant C having a “quiet” atmosphere, the control unit 11 determines the increase in the output volume of the sound output device 3d as the output volume of the sound output device 3b corresponding to the occupant B. You may correct | amend so that it may become smaller than a raise. As a result, sound can be output at a volume suitable for the passengers A to D of the vehicle 200.

Further, when the control unit 11 determines the presence / absence of an occupant in the vehicle based on an image signal obtained by photographing the inside of the vehicle, the control unit 11 performs control so as to start the process of FIG. 5 when determining that there are a plurality of occupants in the vehicle. May be. Sensor information such as a weight sensor provided in the seat may be used for the determination.
Thereby, the power consumption of the sound output control device 2 can be suppressed.

FIG. 7 is a diagram showing another arrangement example of the sound output control system 1, and shows a case where the sound output control system 1 is arranged in the vehicle 200. In the example shown in FIG. 7, the sound input devices 4a to 4d are provided corresponding to the seats on which the occupants A to D are seated, and the occupant D in the rear seat carries the portable terminal 5. Here, the control of the sound output of the in-vehicle call performed by the occupant A and the occupant D via the sound output control device 2 and the portable terminal 5 will be described.

FIG. 8 is a flowchart showing call processing by the mobile terminal 5, and shows a series of processing in in-car call using the mobile terminal 5.
In response to the start operation of the occupant D, the mobile terminal 5 searches the sound output control device 2 to check whether the sound output control device 2 has been detected (step ST1b). If the sound output control device 2 is not detected (step ST1b; NO), the portable terminal 5 repeats the search for the sound output control device 2. When the sound output control device 2 is detected (step ST1b; YES), the mobile terminal 5 establishes a communication connection with the sound output control device 2 and transmits position information of the mobile terminal 5 (step ST2b). The position information of the portable terminal 5 is information for specifying the occupant, and may be information indicating a seat on which the occupant D is seated.
Subsequently, the mobile terminal 5 collects sound around the rear seat on which the occupant D is seated, and transmits this input sound signal to the sound output control device 2 (step ST3b).

Thereafter, the portable terminal 5 starts an in-car call via the sound output control device 2 (step ST4b). In this in-car call, the utterance voice of the occupant A is input to the sound input device 4 and output from the speaker of the portable terminal 5, and the utterance voice of the occupant D is input to the microphone of the portable terminal 5 and output as sound. Sound is output from the device 3a. A control signal is transmitted from the sound output control device 2 to the portable terminal 5, and the output volume of the speaker of the portable terminal 5 becomes a volume corresponding to this control signal.
The portable terminal 5 checks whether or not the in-car call has ended (step ST5b). If not completed (step ST5b; NO), the process returns to step ST4b. If the call has ended (step ST5b; YES), the process of FIG. 8 is ended.

FIG. 9 is a flowchart showing a sound output control process of the mobile terminal 5 by the sound output control device 2, and shows a series of processes in an in-car call using the mobile terminal 5.
The acquisition unit 15 of the sound output control device 2 searches the mobile terminal 5 via the communication I / F unit 14 and confirms whether the mobile terminal 5 has been detected (step ST1c). If the mobile terminal 5 is not detected (step ST1c; NO), the acquisition unit 15 repeats the search for the mobile terminal 5.

When the mobile terminal 5 is detected (step ST1c; YES), the communication I / F unit 14 establishes a communication connection with the mobile terminal 5 and receives the position information of the mobile terminal 5 (step ST2c). Subsequently, the communication I / F unit 14 receives the input sound signal from the portable terminal 5 (step ST3c). The acquisition unit 15 acquires the position information of the mobile terminal 5 and the input sound signal received by the communication I / F unit 14 and outputs them to the analysis unit 16.

The atmosphere estimation unit 17 estimates the atmosphere in the vehicle for each occupant based on the analysis result of the analysis unit 16 (step ST4c).
When the in-car call is started, the acquisition unit 15 acquires the sound signals input to the sound input devices 4a to 4d in addition to the sound signal received from the mobile terminal 5, and outputs the acquired sound signals to the analysis unit 16. The analysis unit 16 acoustically analyzes input sound signals from the mobile terminal 5 and the sound input device 4d to obtain one of conversation content, voice tone, and utterance frequency. Similarly, the analysis unit 16 performs acoustic analysis on the sound signals input to the sound input devices 4a to 4c. Based on these analysis results, the atmosphere estimation unit 17 estimates the atmosphere inside the passengers A to D.

The control unit 11 controls the call volume based on the atmosphere inside the passengers A to D estimated by the atmosphere estimation unit 17 (step ST5c).
For example, when the control unit 11 determines the output volume according to the atmosphere in the passenger A's vehicle, the controller 11 corrects the output volume in consideration of the atmosphere in the passenger B sitting next to the passenger A. The sound output device 3a is controlled to output sound at the corrected output volume.
When the control unit 11 determines the output sound volume corresponding to the occupant D's interior atmosphere, the control unit 11 corrects the output volume in consideration of the interior of the occupant C seated next to the occupant D, and then corrects the output volume. Create a control signal to output sound at the output volume. The control signal is transmitted to the mobile terminal 5 by the communication I / F unit 14.

The control unit 11 confirms whether or not the in-car call has ended (step ST6c). If not completed (step ST6c; NO), the process returns to step ST4c. If the call has ended (step ST6c; YES), the process of FIG. 9 is ended.
As described above, when the mobile terminal 5 is a control target, it is not necessary to provide an in-vehicle speaker and an in-vehicle microphone for an occupant who uses the mobile terminal 5. Therefore, when all the occupants are provided with the portable terminal 5 and control these sound outputs, the vehicle-mounted speaker and the vehicle-mounted microphone are not required, so that the cost required for introducing the sound output control system 1 can be reduced.

As described above, the sound output control device 2 according to the first embodiment is based on the estimation unit 10 that estimates the atmosphere in the vehicle for each occupant of the vehicle 200, and the atmosphere in the vehicle for each occupant estimated by the estimation unit 10. And a control unit 11 that controls sound output for each occupant. The control part 11 controls the sound output of the in-vehicle call performed between the passengers of the vehicle 200, and controls the output of the reproduction sound of the media. Since the sound output is controlled for each occupant by these configurations, the sound can be output at a volume suitable for each occupant of the vehicle 200.

Embodiment 2. FIG.
FIG. 10 is a block diagram showing a configuration of a sound output control device 2A according to Embodiment 2 of the present invention. In FIG. 10, the same components as those in FIG.
The sound output control device 2A includes an estimation unit 10A and a control unit 11A as a configuration for controlling sound output. The estimation unit 10A includes an acquisition unit 15A, an analysis unit 16, an atmosphere estimation unit 17, and a noise estimation unit 18.

The acquisition unit 15A acquires information used for estimation of the atmosphere in the vehicle and estimation of the noise in the vehicle for each occupant. For example, the acquisition unit 15A acquires, as occupant information, the sound signal input by the sound input device in the vehicle and the image information in the vehicle photographed by the photographing device 8 as in the first embodiment. The acquisition unit 15A acquires the vehicle information acquired by the vehicle information acquisition unit 6 as information used for estimation of in-vehicle noise. The vehicle information is information related to the state of the vehicle and the driving operation of the vehicle, and includes, for example, window opening, engine speed, vehicle speed, accelerator opening, and vehicle position information.

The noise estimation unit 18 estimates vehicle interior noise for each occupant based on at least one of the vehicle information and the sound signal input to the sound input device. For example, the noise estimation unit 18 estimates the road noise level using the traveling state and traveling location of the vehicle specified from the vehicle information, and estimates the wind noise level using the opening of the window near the passenger. The noise estimation unit 18 uses the noise obtained by adding the wind noise level to the road noise level as the in-vehicle noise for each occupant.
Further, the noise estimation unit 18 uses the signal level obtained by removing the sound level of the utterance voice and the media reproduction sound acquired by the acquisition unit 15 from the sound signal input to the sound input device as the vehicle interior noise level for each occupant. Good.

The control unit 11A outputs the sound output of the sound output devices 3a to 3d for each occupant based on the vehicle interior for each occupant estimated by the atmosphere estimation unit 17 and the vehicle interior noise for each occupant estimated by the noise estimation unit 18. Control. For example, the control unit 11A may select the output volume of the sound output device for each occupant from the table data in which the output volume of the sound output device is associated with the vehicle interior and the vehicle interior noise.

Each function of the estimation unit 10A and the control unit 11A in the sound output control device 2A is realized by a processing circuit. That is, the sound output control device 2A includes a processing circuit for executing these functions. As shown in FIGS. 2A and 2B, the processing circuit may be dedicated hardware or a CPU that executes a program stored in a memory.

Next, the operation will be described.
FIG. 11 is a flowchart showing the operation of the estimation unit 10A, and shows details of processing corresponding to step ST1 in FIG.
First, the acquisition unit 15A acquires occupant information used to estimate the atmosphere in the vehicle and vehicle information used to estimate vehicle noise (step ST1d). For example, the acquisition unit 15A obtains the sound signal input to the sound input device and the vehicle information at all times during the activation of the sound output control system 1 or periodically or always after the trigger event occurs. get. As a result, sounds around the passenger's seat are acquired as sound signals, and vehicle information is acquired. As in the case of the first embodiment, the event includes an operation that is a starting point for generating a sound output, such as an in-car call start operation and a media playback start operation. In addition to or instead of the sound signal input to the sound input device, the acquisition unit 15 </ b> A may acquire in-vehicle image information captured by the image capturing device 8. It is assumed that all the passengers in the vehicle are photographed in this image information.

Next, the analysis unit 16 analyzes the occupant information acquired by the acquisition unit 15A, and obtains information serving as an estimation standard for the atmosphere in the vehicle for each occupant (step ST2d). This process is the same as step ST2a in FIG.
The atmosphere estimation unit 17 estimates the atmosphere in the vehicle for each occupant based on the analysis result of the analysis unit 16 (step ST3d). This process is also the same as step ST3a in FIG.

The noise estimation unit 18 estimates in-vehicle noise for each occupant based on at least one of vehicle information and occupant information (step ST4d).
For example, road noise table data in which the vehicle running state and location and road noise level are associated with each other, and wind noise table data in which the window opening and the wind noise level are associated with each other are stored in the storage unit 7. Remember.
The noise estimation unit 18 refers to the road noise table data read from the storage unit 7 and estimates the road noise level corresponding to the traveling state and the traveling location of the vehicle specified from the vehicle information. The road noise level is a base level of the noise level in the vehicle.
Subsequently, the noise estimation unit 18 refers to the table data for wind noise read from the storage unit 7 and estimates the wind noise level corresponding to the opening degree of the window near the passenger for each passenger.
The vehicle interior noise level for each occupant is, for example, a sound level obtained by adding a wind noise level to a road noise level.
In addition, the noise estimation unit 18 obtains a sound level obtained by removing the level of the uttered voice of the occupant or the media playback sound from the sound level of the sound signal input to the sound input devices 4a to 4d provided for each seat in the vehicle. The in-vehicle noise may be estimated for each passenger.

When the process shown in FIG. 11 is completed, the control unit 11A determines the output volume for each occupant based on the in-vehicle atmosphere and the in-vehicle noise estimated by the estimation unit 10A, and outputs sound with the determined output volume. To control the sound output device.
For example, similarly to the first embodiment, the control unit 11A multiplies the reference volume for each sound output device by the weight set for each atmosphere in the vehicle, thereby setting the output volume of the sound output device for each occupant. calculate. Moreover, 11 A of control parts may select the output volume of the sound output device for every passenger | crew from the table data which matched the atmosphere in a vehicle, and the volume of the sound output device.
Next, the control unit 11A corrects the output volume so that the output volume obtained as described above is larger than the in-vehicle noise level. At this time, the control unit 11A controls the degree of increasing the output volume in consideration of the atmosphere in the vehicle for each occupant and the positional relationship between the occupants in the vehicle.
For example, when the volume of the sound output device corresponding to the occupant y seated next to the occupant x is increased, the increase is more asleep than when the occupant x is awake ("quiet" atmosphere) Is corrected to be smaller.

Further, when the control unit 11A determines the presence or absence of an occupant in the vehicle based on the image signal obtained by photographing the inside of the vehicle, the control unit 11A performs control so as to start the process of FIG. 11 when determining that there are a plurality of occupants in the vehicle. May be. Sensor information such as a weight sensor provided in the seat may be used for the determination.
Thereby, the power consumption of the sound output control device 2A can be suppressed.

As described above, in the sound output control device 2A according to Embodiment 2, the control unit 11A controls the sound output for each occupant based on the in-vehicle noise for each occupant in addition to the in-vehicle atmosphere for each occupant. . Even with this configuration, sound output is controlled for each occupant, so that sound can be output at a volume suitable for each occupant of the vehicle.

Embodiment 3 FIG.
FIG. 12 is a block diagram showing a configuration of a sound output control device 2B according to Embodiment 3 of the present invention. 12, the same components as those in FIGS. 4 and 10 are denoted by the same reference numerals, and the description thereof is omitted. The sound output control device 2B includes an estimation unit 10 or an estimation unit 10A and a control unit 11B as a configuration for controlling sound output. The control unit 11B includes a determination unit 19, a history information acquisition unit 20, and a volume control unit 21.

The determination part 19 determines the presence or absence of a passenger | crew's boarding experience based on the image signal by which the inside of a vehicle was image | photographed. The determination target occupant is specified by the result of acoustic analysis of the sound signal for each occupant.
The history information acquisition unit 20 reads out the history information of the sound output of the occupant determined by the determination unit 19 as having experience in riding from the storage unit 7 and outputs the history information to the volume control unit 21. Instead, the sound output default information is output to the volume control unit 21.
The default information is information indicating a default value of the sound output device, and is stored in the storage unit 7 in association with each sound output device.
The volume control unit 21 is based on the atmosphere in the vehicle for each occupant estimated by the estimation unit 10 or the estimation unit 10A, and the sound output history information or default information for each occupant acquired by the history information acquisition unit 20, The sound output of the sound output device for each passenger is controlled.

The functions of the estimation unit 10 or the estimation unit 10A and the control unit 11B in the sound output control device 2B are realized by a processing circuit. That is, the sound output control device 2B includes a processing circuit for executing these functions. As shown in FIGS. 2A and 2B, the processing circuit may be dedicated hardware or a CPU that executes a program stored in a memory.

Next, the operation will be described.
FIG. 13 is a flowchart showing the operation of the control unit 11B, and shows details of processing corresponding to step ST2 of FIG. In addition, the structure which the control part 11B connected with the estimation part 10 is mentioned as an example as the sound output control apparatus 2B.
First, the history information acquisition unit 20 acquires the estimation information of the atmosphere in the vehicle for each occupant estimated by the estimation unit 10 (step ST1e).

Next, the determination unit 19 specifies an occupant from the image signal obtained by photographing the inside of the vehicle, and determines whether the specified occupant has a boarding experience (step ST2e).
For example, information indicating the face pattern of an occupant having a boarding experience is stored in the storage unit 7.
The determination unit 19 compares the face pattern stored in the storage unit 7 with the face image of the occupant obtained by image analysis of the image signal, and the facial features and face pattern extracted from the face image match. In this case, it is determined that the passenger has a riding experience.
In addition, the determination unit 19 compares the acoustic characteristics of the occupant's voice obtained by acoustic analysis of the sound signal of the uttered voice input to the sound input device in the vehicle and the acoustic characteristics of the occupant's voice with riding experience. If they match, it may be determined that the occupant has a riding experience.

When it is determined by the determination unit 19 that the occupant has boarding experience (step ST2e; YES), the history information acquisition unit 20 acquires history information of sound output corresponding to the occupant from the storage unit 7 (step ST3e). . As described in the first embodiment, in the sound output history information, the output volume set in the sound output device is registered for each occupant and for each sound source, and the identification information of the occupant is associated. Yes. The history information acquisition unit 20 acquires history information corresponding to the occupant identification information from the storage unit 7.

When the determination unit 19 determines that the occupant has no boarding experience (step ST2e; NO), the history information acquisition unit 20 stores the default information of the sound output device provided corresponding to the occupant's seat in the storage unit 7 (Step ST4e). The sound output history information or default information for each occupant thus obtained is output to the volume control unit 21.

The volume control unit 21 determines the output volume of the sound output device for each occupant based on the atmosphere in the vehicle for each occupant and the sound output history information or default value (step ST5e).
First, the volume control unit 21 confirms whether the occupant whose atmosphere is estimated by the estimation unit 10 is the occupant corresponding to the sound output history information or the default information. The estimation unit 10 obtains the above estimation information of the occupant for each seat.
Therefore, the volume control unit 21 determines whether the occupant of the estimation information is the history information of the sound output or the occupant seat of the estimation information based on the result of comparing the seat of the occupant in the estimation information with the seat corresponding to the sound output history information or default information. Determine which of the occupants is the default information.
Then, the volume control unit 21 considers the atmosphere in the vehicle for each occupant and the positional relationship between the occupants in the vehicle, and outputs a value obtained by correcting the output volume indicated by the sound output history information or the default information after the control. Volume.
For example, when the output volume indicated by the history information of the occupant y seated next to the occupant x is larger than the current output volume, the volume control unit 21 outputs the history information if the occupant x has occurred. Increase to volume. On the other hand, if the occupant x is asleep, the volume control unit 21 sets a value smaller than the output volume indicated by the history information as the output volume of the sound output device corresponding to the occupant y.

The volume control unit 21 controls the sound output device to output sound at the output volume for each occupant determined in step ST5e (step ST6e). By using the sound output history information, it is possible to reduce the calculation load when determining the output volume of the sound output device corresponding to each occupant.
The sound output history information is automatically created by the volume control unit 21 and stored in the storage unit 7. For example, when the volume is manually set by the occupant, the volume control unit 21 creates history information on the assumption that the volume is the optimal volume for the occupant. The data are stored in the storage unit 7 in association with each other.
When the volume is not set by the occupant, the volume control unit 21 creates history information on the assumption that the volume previously set according to the sound output device is the optimal volume for the occupant, and the passenger's interior atmosphere at this time The information is stored in the storage unit 7 in association with the in-vehicle noise.

Further, when the control unit 11B determines the presence or absence of an occupant in the vehicle based on the image signal obtained by photographing the inside of the vehicle, the control unit 11B performs control so as to start the process of FIG. 13 when determining that there are a plurality of occupants in the vehicle. May be. Sensor information such as a weight sensor provided in the seat may be used for the determination.
Thereby, the power consumption of the sound output control device 2B can be suppressed.

As described above, in the sound output control device 2B according to the third embodiment, the control unit 11B determines the sound output for each occupant based on the sound output history information for each occupant in addition to the atmosphere in the vehicle for each occupant. To control. Even with this configuration, sound output is controlled for each occupant, so that sound can be output at a volume suitable for each occupant of the vehicle.

The control unit 11B may control the sound output for each occupant based on the atmosphere in the vehicle for each occupant, the in-vehicle noise for each occupant, and the sound output history information.
For example, the sound output history information stored in the storage unit 7 is associated with vehicle interior noise when the output sound volume is set in addition to the estimation information of the atmosphere in the vehicle. The history information acquisition unit 20 acquires history information for each occupant from the storage unit 7 based on the estimation information of the atmosphere in the vehicle and the noise in the vehicle estimated by the estimation unit 10A. The volume control unit 21 determines the output volume of the sound output device for each occupant based on the estimated information of the atmosphere in the vehicle for each occupant, the estimated value of the in-vehicle noise, and the history information or default value of the sound output. Even with this configuration, sound output is controlled for each occupant, so that sound can be output at a volume suitable for each occupant of the vehicle.

Embodiment 4 FIG.
In the fourth embodiment, a case where sound output in an in-car call performed between one-to-one occupants and a case where sound output in an in-car call performed between one-to-one occupants are controlled are described. Since the configurations of the sound output control system and the sound output control device according to the fourth embodiment are the same as those of the first embodiment, the configurations of the sound output control system and the sound output control device will be described below with reference to FIGS. 4 is referred to.

FIG. 14 is a diagram illustrating an arrangement example of the sound output control system 1 according to the fourth embodiment. A vehicle 200A shown in FIG. 14 is a three-row seat vehicle. The sound input device 4 is provided corresponding to the occupant A who is a driver, and the occupant in the second row seats has the portable terminal 5a, and the occupant in the third row seat has the portable terminal 5b. . The portable terminal 5a and the portable terminal 5b have the same configuration as the portable terminal 5 shown in FIG. 1 and function in the same manner.

A sound output device 3a is provided corresponding to the occupant A who is the driver, a sound output device 3b is provided corresponding to the occupant B in the passenger seat, and a sound corresponding to the seat where the occupant C in the second row is seated. An output device 3c is provided, and a sound output device 3d is provided corresponding to the seat on which the passenger D in the second row is seated. Furthermore, a sound output device 3e is provided corresponding to the seat on which the third row of passengers E is seated, and a sound output device 3f is provided corresponding to the seat on which the third row of passengers F is seated.

FIG. 15 is a flowchart showing sound output control processing in an in-car call performed between a plurality of occupants.
Hereinafter, in-car calls performed between a plurality of occupants will be referred to as public-mode in-car calls, and sound output control in public-mode in-car calls performed by occupant A and occupants B to F will be described.

First, the arithmetic processing unit 9 detects the sound input device of the parent device (step ST1f).
For example, the arithmetic processing unit 9 detects a sound input device or a portable terminal set in advance as a parent device in the public mode, or a sound input device of a device in which a public mode in-car call start operation is performed or The portable terminal is detected as the sound input device of the parent device. Here, it is assumed that the sound input device 4 is the sound input device of the parent device, and the sound output device 3a is the sound output device of the parent device.

The control unit 11 masks (blocks) a call using a sound input device other than the parent device (step ST2f). As a result, only the call between the child device and the parent device becomes valid, and the in-car call in the public mode performed by the passenger A and the passenger B to the passenger F is started.
In the in-car call in the public mode, a two-way conversation between the parent device and the child device is possible.

The acquisition unit 15 acquires input sound signals input to the sound input device 4 of the parent device and the microphones of the portable terminals 5a and 5b that are child devices (step ST3f). Thereby, the acquisition unit 15 receives the sound around the first row of seats input to the sound input device 4, the sound around the second row of seats input to the microphone of the mobile terminal 5a, and the microphone of the mobile terminal 5b. The sound around the third row of seats input to is acquired as a sound signal. The analysis unit 16 acoustically analyzes the sound signal acquired by the acquisition unit 15 and obtains information serving as an estimation standard for the atmosphere in the vehicle for each occupant.

Next, the atmosphere estimation unit 17 estimates the atmosphere in the vehicle for each occupant based on information serving as an estimation criterion for the atmosphere in the vehicle obtained by the analysis unit 16 (step ST4f).
For example, the atmosphere estimation unit 17 estimates the atmosphere in the vehicle for each occupant from the sound signal for each occupant based on the content of the conversation, the tone of the voice, and the utterance frequency. Moreover, the atmosphere estimation part 17 may estimate the atmosphere in a vehicle for every passenger | crew based on a passenger's facial expression and gesture.

The control unit 11 determines an output volume for each occupant based on the atmosphere in the vehicle for each occupant estimated by the atmosphere estimation unit 17, and outputs a sound with the determined output volume. The sound output with the sound output device of the slave unit is controlled (step ST5f).
Note that the sound output device of the child device may be a speaker provided in the mobile terminals 5a and 5b, but may also be the sound output devices 3b to 3f corresponding to the passengers B to F.
Thereby, in the in-car call in the public mode, control is performed to increase the output volume of the sound output device corresponding to an occupant who is active in conversation and to decrease the output volume of the sound output device corresponding to an occupant who is not active in conversation. . Also, the volume of the sound output device corresponding to the sleeping passenger is set to 0 (output stop).

Thereafter, the control unit 11 confirms whether or not the in-car call in the public mode is finished (step ST6f). If not completed (step ST6f; NO), the process returns to step ST3f. If the telephone call has ended (step ST6f; YES), the processing in FIG. 15 is ended. As a result, in-car calls in public mode can be performed at a volume suitable for each occupant.

Although the sound output control in the in-car call in the public mode has been described so far, the same control may be applied to the control of the sound output when the media playback sound is distributed in a one-to-multiple manner.
In this case, the control unit 11 of the sound output control device 2 synthesizes the media reproduction sound reproduced by the media player of the parent machine as the output sound, and uses the output volume determined based on the atmosphere in the vehicle for each occupant. The synthesized sound is output to the sound output device.

FIG. 16 is a diagram illustrating another arrangement example of the sound output control system 1 according to the fourth embodiment. A vehicle 200B shown in FIG. 16 is a vehicle having three or more rows of seats. The sound input device 4 is provided corresponding to the occupant A who is the driver, and the occupant in the last row of seats has the portable terminal 5c. The portable terminal 5c has the same configuration as the portable terminal 5 shown in FIG. 1, and functions in the same manner.

A sound output device 3a is provided corresponding to the occupant A who is the driver, a sound output device 3b is provided corresponding to the occupant B in the passenger seat, and a sound corresponding to the seat where the occupant C in the second row is seated. An output device 3c is provided, and a sound output device 3d is provided corresponding to the seat on which the passenger D in the second row is seated. Further, a sound output device 3i is provided corresponding to the seat on which the occupant I in the last row is seated, and a sound output device 3j is provided corresponding to the seat on which the occupant J is seated.

FIG. 17 is a flowchart showing a sound output control process in an in-car call performed between one-on-one passengers. Hereinafter, in-car calls performed between one-to-one occupants will be referred to as private mode in-car calls, and sound output control in private mode in-car calls performed by occupants A and J will be described.

First, the arithmetic processing unit 9 detects the sound input device of the parent device (step ST1g).
For example, the arithmetic processing unit 9 detects a sound input device or portable terminal set in advance as a parent device in the private mode, or a sound input device or portable terminal of a device in which a private mode in-car call start operation is executed Is detected. Here, it is assumed that the sound input device 4 is the sound input device of the parent device, and the sound output device 3a is the sound output device of the parent device.

Next, the arithmetic processing part 9 selects a subunit | mobile_unit (step ST2g).
For example, the arithmetic processing unit 9 detects a sound input device or a portable terminal set in advance as a private mode child device, or a sound input device of a device in which a private mode in-car call start operation is performed or A mobile terminal is detected as a slave unit. Here, it is assumed that the portable terminal 5c is a child device.

The acquisition unit 15 acquires the input sound signal input to the sound input device 4 of the parent device and the microphone of the portable terminal 5c that is the child device (step ST3g). Thereby, the acquisition unit 15 acquires the sound around the first row of seats input to the sound input device 4 and the sound around the last row of seats input to the microphone of the mobile terminal 5c as sound signals. The analysis unit 16 acoustically analyzes the sound signal acquired by the acquisition unit 15 and obtains information serving as an estimation standard for the atmosphere in the vehicle for each occupant.

Next, the atmosphere estimation unit 17 estimates the atmosphere in the vehicle for each occupant based on information serving as an estimation criterion for the atmosphere in the vehicle obtained by the analysis unit 16 (step ST4g).
For example, the atmosphere estimation unit 17 estimates the atmosphere in the vehicle for each occupant from the sound signal for each occupant based on the content of the conversation, the tone of the voice, and the utterance frequency. Moreover, the atmosphere estimation part 17 may estimate the atmosphere in a vehicle for every passenger | crew based on a passenger's facial expression and gesture.

Subsequently, the control unit 11 determines the output volume for each occupant based on the atmosphere in the vehicle for each occupant estimated by the atmosphere estimation unit 17, and outputs the sound at the determined output volume. The sound output of 3a and the sound output of the sound output device of the slave unit are controlled (step ST5g).
The sound output device of the child device may be a speaker included in the mobile terminal 5c, but may be a sound output device 3j corresponding to the passenger J.
As a result, in the in-car call in the private mode, control is performed to increase the output volume of the sound output device corresponding to an occupant who is active in conversation and to decrease the output volume of the sound output device corresponding to an occupant who is not active in conversation. .

Thereafter, the control unit 11 confirms whether or not the in-car call in the private mode is finished (step ST6g). If not completed (step ST6g; NO), the process returns to step ST3g. If the call has ended (step ST6g; YES), the processing in FIG. 17 is ended. As a result, in-car calls in private mode can be performed at a volume suitable for each occupant.

So far, the sound output control in the in-car call in the private mode has been described, but the same control may be applied to the control of the sound output when the media playback sound is distributed one-on-one.
In this case, the control unit 11 of the sound output control device 2 synthesizes the media reproduction sound reproduced by the media player of the parent machine as the output sound, and uses the output volume determined based on the atmosphere in the vehicle for each occupant. The synthesized sound is output to the sound output device.

In addition, although the case where the sound output control device 2 controls the sound output in the in-car call in the public mode and the in-car call in the private mode has been shown, the sound output control device 2A may perform the same control. The apparatus 2B may perform the same control.

As described above, in the sound output control system 1 according to Embodiment 4, the control unit 11 controls the sound output in the in-car call in the public mode for each occupant. As a result, in-car calls in public mode can be performed at a volume suitable for each occupant.

In the sound output control system 1 according to the fourth embodiment, the control unit 11 controls the sound output in the in-car call in the private mode for each occupant. As a result, in-car calls in private mode can be performed at a volume suitable for each occupant.

In the first to fourth embodiments, the configuration in which the sound output control system is mounted on the vehicle has been described. However, the present invention is not limited to this.
That is, the sound output control device may be provided in a portable terminal brought into the vehicle as long as the sound output for each occupant can be controlled, or may be mounted on a server that can communicate with the vehicle side.

In the present invention, within the scope of the invention, any combination of each embodiment, any component of each embodiment can be modified, or any component can be omitted in each embodiment. .

Since the sound output control device according to the present invention can output sound at a volume suitable for each vehicle occupant, it is suitable for control of sound output during in-car calls or media reproduction in the vehicle between vehicle occupants. .

1 sound output control system, 2, 2A, 2B sound output control device, 3a-3j sound output device, 4, 4a-4d sound input device, 5, 5a-5c mobile terminal, 6 vehicle information acquisition unit, 7 storage unit, 8 imaging device, 9 arithmetic processing unit, 10, 10A estimation unit, 11, 11A, 11B control unit, 12a-12c signal conversion unit, 13a, 13b signal amplification unit, 14 communication I / F unit, 15, 15A acquisition unit, 16 analysis unit, 17 atmosphere estimation unit, 18 noise estimation unit, 19 determination unit, 20 history information acquisition unit, 21 volume control unit, 100, 102 signal I / F, 101 in-vehicle speaker, 103 in-vehicle microphone, 104 communication I / F , 106 storage device, 107 processing circuit, 108 CPU, 109 memory, 200, 200A, 200B vehicle.

Claims (11)

1. An estimation unit for estimating an atmosphere in each of a plurality of occupants of the vehicle;
   A sound output control device comprising: a control unit that controls sound output for each occupant based on the atmosphere in the vehicle for each occupant estimated by the estimation unit.
2. The control unit controls sound output for each occupant based on at least one of in-vehicle noise for each occupant and in-vehicle noise for each occupant and history information of sound output for each occupant. The sound output control device according to claim 1.
3. The sound output control device according to claim 1, wherein the control unit controls sound output of an in-car call performed between occupants of the vehicle.
4. The sound output control apparatus according to claim 1, wherein the control unit controls the output of the reproduction sound of the media.
5. A plurality of sound output devices provided in the vehicle;
   An estimation unit for estimating an atmosphere in each of a plurality of occupants of the vehicle;
   A sound output control system comprising: a control unit that controls the sound output of the sound output device for each occupant based on the atmosphere in the vehicle for each occupant estimated by the estimation unit.
6. The control unit controls the sound output of the sound output device for each occupant based on at least one of in-vehicle noise for each occupant and history information of sound output for each occupant in addition to the atmosphere in the vehicle for each occupant. The sound output control system according to claim 5.
7. The sound output control system according to claim 5, wherein the sound output device is a vehicle-mounted speaker.
8. The sound output control system according to claim 5, wherein the sound output device is a speaker included in a mobile terminal.
9. The sound output control system according to claim 5, wherein the control unit controls sound output of the sound output device for each passenger in an in-car call performed between a plurality of passengers.
10. The sound output control system according to claim 5, wherein the control unit controls the sound output of the sound output device for each passenger in an in-car call performed between one-to-one passengers.
11. An estimation unit estimating an atmosphere in each of a plurality of passengers of the vehicle;
    A control unit comprising: a step of controlling sound output for each occupant based on the atmosphere in the vehicle for each occupant estimated by the estimation unit.

Images