WO2017183372A1

WO2017183372A1 - Vehicle interior conversion assist device

Info

Publication number: WO2017183372A1
Application number: PCT/JP2017/010774
Authority: WO
Inventors: 家田　清一; 一平菅江
Original assignee: アイシン精機株式会社
Priority date: 2016-04-18
Filing date: 2017-03-16
Publication date: 2017-10-26
Also published as: JP2017193207A

Abstract

A vehicle interior conversion assist device provided with a sound collection unit for collecting sound information in a vehicle interior, a crew detection unit for detecting a crew in the vehicle interior, a conversation determination unit for determining whether or not the sound information is the one that indicates the conversion of the crew detected in the vehicle interior, a speaker specification unit for specifying the speaker of a conversation when the sound information is the one that indicates the conversion of the crew, and a selective collection and output unit for selectively collecting the voices of the speaker and outputting the collected voices.

Description

In-car conversation support device

The present invention relates to a vehicle interior conversation support device.

Conventionally, there is a vehicle interior conversation assist device that amplifies the sound of an occupant collected in the vehicle interior with a speaker. For example, the vehicle interior conversation assisting device described in Patent Document 1 includes a sound collection microphone and a speaker provided on a ceiling portion of the vehicle compartment on the front seat side and the rear seat side of the vehicle, respectively. Then, the sound picked up by the sound collecting microphone on the front seat side is output from the speaker on the rear seat side, and the sound picked up by the sound collecting microphone on the back seat side is output from the speaker on the front seat side, It is the structure which assists the conversation between the passenger | crew who sits in a seat, and the passenger | crew who sits in a backseat.

The sound collecting microphone on the front seat side is provided on the front side of the speaker on the front seat side, and the sound collecting microphone on the rear seat side is provided on the rear side of the speaker on the rear seat side. The sound collecting microphone on the front seat side has a sound collecting area directed toward the vehicle front side, and the sound collecting microphone on the rear seat side has a sound collecting area directed toward the vehicle rear side.

採用 By adopting such a configuration, it becomes difficult for the sound collecting microphone to pick up the output of the speaker. As a result, it is possible to suppress the occurrence of howling and realize a clear sound output.

Japanese Patent No. 5122414

However, in an actual vehicle, a sound collecting microphone provided in the vehicle interior picks up various sounds inside and outside the vehicle. And in the above-mentioned prior art in-vehicle conversation assistance device, since these noises still leave the possibility of hindering the conversation, there is still room for improvement in this respect. .

The present invention has been made to solve the above-described problems, and an object of the present invention is to provide a vehicle interior conversation support device that can more clearly convey the voice of the speaker to the listener.

A vehicle interior conversation support device that solves the above problems includes a sound collection unit that collects sound information in the vehicle interior, an occupant detection unit that detects an occupant in the vehicle interior, and an occupant in which the sound information is detected in the vehicle interior A conversation determination unit that determines whether the conversation indicates a conversation of the passenger, a speaker identification unit that identifies a speaker of the conversation when the sound information indicates the conversation of the occupant, and the speaker And a selective collection output unit that selectively collects and outputs the voice of the above.

According to the above configuration, the voice of the speaker can be transmitted to the listener more clearly even in situations where the sound inside and outside the vehicle hinders the conversation. And thereby, the convenience of a passenger can be improved.

In the vehicle interior conversation support device, a seating position specifying unit that specifies a seating position of the occupant in the vehicle interior, a sound source specifying unit that specifies a sound source of the sound information, and a sound source of the sound information are detected in the vehicle interior. A match determination unit that determines whether or not the seating position of any occupant coincides with the seating position of the occupant. In this case, it is preferable to specify the occupant as a speaker of the conversation.

According to the above configuration, the speaker of the conversation can be specified with high accuracy. As a result, the voice of the occupant who is the speaker can be transmitted to the listener more clearly.
The vehicle interior conversation support device may further include a microphone array provided in the vehicle interior having a plurality of directional microphones facing different directions. The sound source specifying unit preferably specifies a sound source direction of the sound information based on a position where the microphone array is provided based on an input level of each directional microphone, and the match determination unit When the seating position of the passenger is in the sound source direction of the sound information, it is preferable to determine that the seating position of the passenger matches the sound source.

According to the above configuration, it is possible to accurately determine whether the sound source of the sound information collected using the sound collection microphone matches the seating position of any occupant detected in the passenger compartment.
Alternatively, the vehicle interior conversation support device may further include a plurality of directional microphones provided in the vehicle interior in a state in which they face in different directions. The selective collection output unit selects a directional microphone facing the direction of the speaker from the plurality of directional microphones and collects the voice of the speaker using the selected directional microphone. Is preferred.

According to the above configuration, the voice of the speaker can be selectively collected with high accuracy.
The vehicle interior conversation support device further includes a plurality of directional speakers provided in the vehicle interior in directions different from each other, and the selective collection output unit is configured to selectively collect the speech of the speaker. Is preferably output from a directional speaker facing the direction of an occupant other than the speaker detected in the passenger compartment among the plurality of directional speakers.

According to the above configuration, the voice of the speaker can be efficiently transmitted to other occupants who are listeners.
It is preferable that the vehicle interior conversation support apparatus further includes a noise filter that attenuates noise other than voice included in the sound information.

According to the above configuration, the voice of the speaker can be transmitted to the listener more clearly.
The occupant detection unit of the vehicle interior conversation support apparatus may detect an occupant in the vehicle interior based on a captured image projected by a camera provided in the vehicle interior. In this case, the captured image can be shared with vehicle security control.

The occupant detection unit of the vehicle interior conversation support device may detect an occupant in the vehicle interior based on an output of a seating sensor provided on a seat in the vehicle interior. In this case, an occupant in the passenger compartment can be accurately detected with a simple configuration.

According to the present invention, the voice of the speaker can be transmitted to the listener more clearly.

Explanatory drawing which shows the monitor unit provided with the camera, the sound collection microphone, and speaker which were provided in the vehicle interior. Explanatory drawing of the picked-up image which a camera shows when there is no passenger | crew in a vehicle interior. The bottom view which shows schematic structure of a monitor unit. The schematic block diagram of a vehicle interior conversation assistance apparatus. Explanatory drawing of the picked-up image which a camera images when a passenger | crew exists in a vehicle interior. The flowchart which shows the start procedure of vehicle interior conversation assistance control. The flowchart which shows the process sequence of vehicle interior conversation assistance control.

Hereinafter, an embodiment of a vehicle interior conversation support device will be described with reference to the drawings.
As shown in FIG. 1, the vehicle 1 of the present embodiment is provided with a camera 3 that displays an image in the passenger compartment 2. Specifically, in the vehicle 1 of the present embodiment, the camera 3 constitutes a monitor unit 10 that is integrated with the sound collecting microphone 4 and the speaker 5. And the vehicle 1 of this embodiment becomes the structure by which this monitor unit 10 is arrange | positioned in the approximate center part in the ceiling part 2a of the compartment 2, ie, the position between the front seat 7f and the rear seat 7r. ing.

As shown in FIGS. 2 and 3, the camera 3 of the monitor unit 10 of the present embodiment is an omnidirectional camera 23 that can photograph all the seats 7 and all the vehicle windows 20 provided in the passenger compartment 2. .

In the photographed image IP shown in FIG. 2, the seat 7 shown in the lower left is the right front seat (driver's seat) 7fa, and the seat 7 shown in the lower right is the left front seat (passenger seat) 7fb. The two seats 7 shown on the upper side are a right rear seat 7ra and a left rear seat 7rb, respectively. In the photographed image IP shown in FIG. 2, the windshield 20 fa, 20 fb, 20 ra, 20 rb located on the side of each seat 7 and the windshield 20 fc and rear glass 20 rc of the vehicle 1 are also shown as the vehicle window 20.

As shown in FIG. 3, the sound collecting microphone 4 of the monitor unit 10 is a microphone array 24X including a plurality of directional microphones 24 (24a to 24d) facing different directions. The speaker 5 of the monitor unit 10 is a speaker array 25X including a plurality of directional speakers 25 (25a to 25d) that are similarly directed in different directions.

In the monitor unit 10 of the present embodiment, the microphone array 24X has a configuration in which the directional microphones 24 are radially arranged around the position where the omnidirectional camera 23 is provided. Similarly, the speaker array 25X has a configuration in which the directional speakers 25 are arranged radially.

As shown in FIG. 4, in the vehicle 1 of the present embodiment, the monitor unit 10 is connected to a monitor ECU 30. The monitor ECU 30 analyzes the captured image IP reflected by the camera 3 and the sound information IS collected by the sound collection microphone 4. The monitor ECU 30 performs image analysis processing and sound information analysis processing when an authentication ECU connected via a vehicle network (not shown) detects the proximity of a person to the vehicle 1 through wireless communication with a portable device (electronic key). Start. The monitor ECU 30 can also execute sound output via the speaker 5. In the vehicle 1 of the present embodiment, a vehicle interior conversation support device 31 is formed by the monitor ECU 30 and the monitor unit 10.

More specifically, as shown in FIGS. 2 and 5, the monitor ECU 30 of the present embodiment analyzes the captured image IP of the camera 3 provided in the passenger compartment 2, thereby occupant 40 in the passenger compartment 2. That is, the presence / absence of the occupant 40 in the vehicle 1 and its seating position are detected. Specifically, the monitor ECU 30 uses the well-known human authentication logic such as whether or not the captured image IP includes “a portion where it can be determined that a human face is reflected”. The occupant 40 is detected. For example, in the case of the captured image IP shown in FIG. 5, the monitor ECU 30 causes the first occupant 41 seated in the right front seat (driver's seat) 7fa of the vehicle 1 and the second seat seated in the left rear seat 7rb. The occupant 42 is detected.

In addition, the monitor ECU 30 of the present embodiment specifies the sound source of the sound information IS collected using the sound collection microphone 4 based on the comparison of the input levels of the directional microphones 24 constituting the microphone array 24X, that is, the sound collection volume. To do. The monitor ECU 30 determines whether or not the sound source of the sound information IS matches the seating position of any occupant 40 detected in the passenger compartment 2.

Specifically, the monitor ECU 30 of the present embodiment specifies the sound source direction of the sound information IS with reference to the position where the monitor unit 10 including the microphone array 24X is provided, that is, the substantially central portion of the ceiling 2a. . Then, when there is a seat 7 on which the occupant 40 is seated in the sound source direction, it is determined that the seating position of the occupant 40 matches the sound source.

In addition, the monitor ECU 30 of the present embodiment determines whether or not the sound information IS collected using the sound collection microphone 4 indicates the conversation of the occupant 40. This determination is performed using, for example, a known voice recognition function. When the sound information IS in the passenger compartment 2 indicates the conversation of the occupant 40 and the sound source of the sound information IS matches the seating position of any occupant 40, the monitor ECU 30 of the present embodiment This occupant 40 is specified as the speaker 51 of the conversation. And the operation | movement of the monitor unit 10 is controlled so that the audio | voice of this speaker 51 may be selectively collected and output toward the passenger | crew 40 used as the listener 52 other than the speaker 51. FIG.

For example, when the first occupant 41 and the second occupant 42 are in the passenger compartment 2 as shown in FIG. 5 and the first occupant 41 is speaking, the directional microphones constituting the microphone array 24X are used. Among 24a to 24d, the input level (collected sound volume) of the directional microphone 24a (see FIG. 3) facing the direction of the right front seat 7fa on which the first occupant 41 is seated is maximized. Therefore, the monitor ECU 30 can specify that the speaker 51 at this time is the first occupant 41. 3 is a view of the monitor unit 10 provided on the ceiling 2a as viewed from below. In FIG. 3, the upper side is the front side of the vehicle and the left side is the right side of the vehicle.

Further, the monitor ECU 30 of the present embodiment collects the sound information IST collected using the directional microphone 24a facing the first occupant 41 specified as the speaker 51, that is, the voice of the speaker 51. The sound is output from the directional speaker 25d facing the left rear seat 7rb on which the second occupant 42 is seated, that is, toward the listener 52 who is an occupant other than the speaker 51. Furthermore, the monitor ECU 30 of the present embodiment includes a noise filter 55 that attenuates noise other than sound included in the sound information IS collected using the sound collection microphone 4. Thereby, the vehicle interior conversation support device 31 of the present embodiment can clearly convey the voice of the speaker 51 to the listener 52.

Next, the start procedure of the vehicle interior conversation support control executed by the monitor ECU 30 of the present embodiment and the execution procedure thereof will be described.
As shown in the flowchart of FIG. 6, the monitor ECU 30 of the present embodiment first performs image analysis of the captured image IP in the passenger compartment 2 imaged by the camera 3 (step 101), and based on the analysis result, the passenger compartment 2 determines whether or not there is an occupant 40 in step 2 (step 102). When it is determined that there is an occupant 40 in the passenger compartment 2 (step 102: YES), the passenger compartment conversation support control is performed to selectively collect and output the voice of the occupant 40 as the speaker 51. Execute (step 103).

If the monitor ECU 30 determines in step 102 that there is no occupant 40 in the passenger compartment 2 (step 102: NO), then whether or not the vehicle 1 is in a door-locked state, that is, in a locked state. Is determined (step 104). When it is determined that the vehicle 1 is in the door lock state (step 104: YES), the captured image IP around the vehicle 1 displayed by the camera 3 is subjected to image analysis, and security control of the vehicle 1 based on the analysis result is performed. Execute (step 105).

The vehicle interior conversation support control executed in step 103 in the flowchart of FIG. 6 will be described in further detail. As shown in the flowchart of FIG. 7, the monitor ECU 30 of the present embodiment first detects the passenger detected by image analysis in step 101. 40 seating positions, that is, the seat 7 on which the occupant 40 is seated are identified (step 201). Next, the monitor ECU 30 analyzes the sound information IS in the passenger compartment 2 collected using the sound collection microphone 4 of the monitor unit 10 (step 202). Based on the analysis result, the sound source of the sound information IS is specified, specifically, the sound source direction is specified with reference to the position where the sound collection microphone 4 is provided (step 203).

Next, the monitor ECU 30 determines whether or not the seating position of any occupant 40 identified in step 201 matches the sound source of the sound information IS identified in step 203 (step 204). Furthermore, when the sound source of the sound information IS matches the seating position of any occupant 40 (step 204: YES), the monitor ECU 30 determines whether or not the sound information IS indicates the conversation of the occupant 40. Determination is made (step 205). When the sound information IS indicates the conversation of the occupant 40 (step 205: YES), the occupant 40 that matches the sound source of the sound information IS is specified as the speaker 51 of the conversation (step 206). .

Next, the monitor ECU 30 selectively collects the voice of the occupant 40 identified as the speaker 51 (step 207). That is, among the directional microphones 24 (24a to 24d) constituting the microphone array 24X of the monitor unit 10, the directional microphone 24 facing the seat 7 on which the speaker 51 is seated is selected and used. The sound information IST, that is, the voice of the speaker 51 is collected. Further, the monitor ECU 30 of the present embodiment uses the noise filter 55 (see FIG. 4), thereby the sound included in the sound information IST collected by the directional microphone 24 facing the seat 7 on which the speaker 51 is seated. Noise other than the above is attenuated (noise filter processing, step 208). Furthermore, the monitor ECU 30 of the present embodiment is directed to the seat 7 in which the listener 52 who is an occupant other than the speaker 51 sits among the directional speakers 25 (25a to 25d) constituting the speaker array 25X of the monitor unit 10. And the sound information IST after the noise filter processing, that is, the voice of the speaker 51 in a state where the noise is attenuated is output from the selected directional speaker 25 (step 209). .

As described above, according to the present embodiment, the following effects can be obtained.
(1) The monitor ECU 30 collects sound information IS in the passenger compartment 2 by functioning as a sound collection unit together with the sound collection microphone 4. Moreover, monitor ECU30 detects the passenger | crew 40 in the compartment 2 based on the picked-up image IP which the camera 3 shows by functioning as a passenger | crew detection part. Furthermore, the monitor ECU 30 determines whether or not the collected sound information IS indicates the conversation of the occupant 40 by functioning as a conversation determination unit and a speaker specifying unit. If the conversation is indicated, the speaker 51 of the conversation is specified. When the sound information IS indicates the conversation of the occupant 40, the monitor ECU 30 functions as a selective collection output unit together with the sound collection microphone 4 and the speaker 5 provided in the passenger compartment 2. The voice of the speaker 51 is selectively collected and output.

According to the above configuration, the voice of the speaker 51 can be transmitted to the listener 52 more clearly even in a situation where the sound inside and outside the vehicle 1 hinders conversation. And thereby, the convenience of passenger 40 can be improved. In addition, security control of the vehicle 1 can be executed by performing image analysis on the captured image IP projected by the camera 3.

(2) The monitor ECU 30 functions as a seating position specifying unit, thereby specifying the seating position (seat 7 on which the passenger is seated) in the passenger compartment 2 based on the captured image IP reflected by the camera 3. Further, the monitor ECU 30 functions as a sound source specifying unit to analyze the sound information IS collected using the sound collecting microphone 4 in the passenger compartment 2 and specify the sound source of the sound information IS based on the analysis result. To do. Furthermore, the monitor ECU 30 functions as a coincidence determination unit to determine whether or not the sound source of the specified sound information IS matches the seating position of any occupant 40 detected in the passenger compartment 2. Then, when the sound source of the sound information IS matches the seating position of any occupant 40, the monitor ECU 30 functions as a utterer specifying unit, thereby specifying the occupant 40 as the speaker 51 of the conversation.

According to the above configuration, the speaker 51 of the conversation can be specified with high accuracy. As a result, the voice of the occupant 40 as the speaker 51 can be transmitted to the listener 52 more clearly.

(3) A microphone array 24X having a plurality of directional microphones 24 (24a to 24d) facing different directions is provided in the passenger compartment 2. Then, the monitor ECU 30 functions as a selection collection output unit, selects the directional microphone 24 facing the direction of the speaker 51, and collects the voice of the speaker 51 using it. By adopting such a configuration, the voice of the speaker 51 can be selectively collected with high accuracy.

(4) The monitor ECU 30 functions as a sound source specifying unit and a coincidence determining unit, so that the sound source of the sound information IS based on the position where the microphone array 24X is provided based on the input level of each directional microphone 24 When the direction is specified and the seating position of the occupant 40 is in the sound source direction of the sound information IS, it is determined that the seating position of the occupant 40 matches the sound source of the sound information IS. Thereby, it is possible to accurately determine whether or not the sound source of the sound information IS collected using the sound collection microphone 4 matches the seating position of any occupant 40 detected in the passenger compartment 2.

(5) In the passenger compartment 2, a speaker array 25X having a plurality of directional speakers 25 (25a to 25d) facing different directions is provided. The monitor ECU 30 functions as a selective collection output unit, so that the voice of the speaker 51 selectively collected is transmitted from the directional speaker 25 facing the listener 52 who is an occupant 40 other than the speaker 51. Output. Thereby, the voice of the speaker 51 can be efficiently transmitted to the listener 52.

(6) The monitor ECU 30 as the speaker sound information output unit includes a noise filter 55 for attenuating noise other than speech included in the sound information IS collected using the sound collection microphone 4. Thereby, the voice of the speaker 51 can be transmitted to the listener 52 more clearly.

In addition, you may change the said embodiment as follows.
In the above embodiment, the camera 3 constitutes the monitor unit 10 integrated with the sound collecting microphone 4 and the speaker 5. And it decided to arrange | position to the approximate center part in the ceiling part 2a of the compartment 2. As shown in FIG. However, the present invention is not limited to this, and the camera 3 does not necessarily have to be provided integrally with the sound collecting microphone 4 and the speaker 5. You may change arbitrarily, such as a pillar. In addition, a configuration using a wide-angle camera such as the omnidirectional camera 23 is not necessarily required, and the number of cameras may be arbitrarily changed. Further, the arrangement and configuration of the sound collecting microphone 4 and the speakers 5 and the number thereof may be arbitrarily changed.

Specifically, a configuration in which the sound collection microphone 4 is not the microphone array 24X or a configuration in which the speaker 5 is not the speaker array 25X may be employed. For example, a configuration may be employed in which a plurality of directional microphones 24 facing different directions are arranged in the vehicle compartment 2 without forming the microphone array 24X. Even when such a configuration is adopted, the sound source of the sound information IS can be specified based on the input level of each directional microphone 24. Or the structure by which the several directional speaker 25 which faced the mutually different direction is arrange | positioned in the vehicle interior 2 without forming the speaker array 25X may be sufficient.

The vehicle interior conversation support device 31 may not necessarily include the directional microphone 24 and the directional speaker 25. For example, in the configuration in which the sound collecting microphones 4 are provided at a plurality of locations in the passenger compartment 2, the one disposed near the passenger 40 identified as the speaker 51 is selected from the plurality of sound collecting microphones 4. The voice of the speaker 51 may be collected using the selected sound collecting microphone 4. Alternatively, in a configuration in which speakers 5 are provided at a plurality of locations in the passenger compartment 2, a speaker 5 arranged in the vicinity of a listener 52 who is an occupant other than the speaker 51 is selected from the plurality of speakers 5. The speaker 5 may be configured to output the voice of the speaker 51 from the speaker 5. Further, the voice of the speaker 51 collected selectively may not necessarily be output toward the listener 52.

In the above embodiment, when the authentication ECU detects the proximity of a person to the vehicle 1 by wireless communication with a portable device (electronic key), image analysis processing and sound information analysis processing used for in-vehicle conversation support control are started. It was decided to be done. However, the present invention is not limited to this. For example, the start timing of the image analysis processing and the sound information analysis processing is arbitrarily set including the start trigger of the camera 3 and the sound collection microphone 4 such as when the vehicle 1 is turned on (IG on). May be.

In the above embodiment, after determining whether the seating position of the occupant 40 matches the sound source of the sound information IS collected using the sound collection microphone 4, whether the sound information IS indicates a conversation. This determination is performed (see FIG. 7, steps 204 and 205). However, the present invention is not limited to this, and it may be configured to determine whether or not the seating position of the occupant 40 matches the sound source of the sound information IS after determining whether or not the sound information IS indicates conversation. . Thus, by performing screening for “conversation” in advance, the speaker 51 of the conversation can be specified with higher accuracy.

In the above embodiment, the presence / absence of the occupant 40 in the vehicle 1 and its seating position are detected by analyzing the captured image IP of the camera 3 provided in the passenger compartment 2. However, the present invention is not limited to this, and an occupant may be detected using the output of a seating sensor provided on the vehicle seat. The seating sensor may be of any type, such as a pressure sensitive type using a membrane switch or a strain gauge, a capacitance type, etc. As a result, the presence / absence of the occupant 40 and the seating position thereof can be accurately detected in the passenger compartment 2 with a simple configuration without requiring high calculation processing capability.

In the above embodiment, when the sound source of the sound information IS matches the seating position of any occupant 40, the occupant 40 is specified as the speaker 51 of the conversation. You may change arbitrarily about. For example, by analyzing the captured image IP of the camera 3 and detecting the movement of the occupant 40's mouth in the passenger compartment 2, it may be determined whether or not the occupant 40 is the conversation speaker 51. Good.

In the above embodiment, the voice of the speaker 51 that is selectively collected is output to the listener 52 who is an occupant other than the speaker 51 detected in the passenger compartment 2. However, the present invention is not limited to this. By analyzing the captured image IP of the camera 3 and performing human detection around the vehicle 1 outside the vehicle through the vehicle window 20, the listener 52 of the conversation is detected by the person outside the vehicle. When it is determined (for example, when only one occupant 40 is detected in the passenger compartment 2), the voice of the speaker 51 may be output to the listener 52 outside the vehicle.

For example, in the configuration in which the speaker array 25X similar to the above embodiment is provided in the passenger compartment 2, among the directional speakers 25 forming the speaker array 25X, in human detection based on the captured image IP of the camera 3, It is good to select the thing facing the direction of the vehicle window 20 determined that the person outside the vehicle is reflected, and to output the voice of the speaker 51 from the directional speaker 25. Or you may make it output a sound toward the listener 52 outside a vehicle using the speaker 5 provided in the vehicle interior 2. FIG.

In the above embodiment, the voice of the speaker 51 is output from the speaker 5 in a state where the noise is attenuated using the noise filter 55, but such noise attenuation processing is not necessarily performed.

DESCRIPTION OF SYMBOLS 1 ... Vehicle, 2 ... Vehicle compartment, 2a ... Ceiling part, 3 ... Camera (occupant detection part, speaker identification part, seating position identification part, and coincidence determination part), 4 ... Sound collection microphone (sound collection part, speaker) Specific unit, coincidence determination unit, and selective collection output unit), 5 ... speaker (selection collection output unit), 7 ... seat, 7f ... front seat, 7r ... rear seat, 7fa ... right front seat, 7rb ... left rear seat DESCRIPTION OF SYMBOLS 10 ... Monitor unit, 20 ... Car window, 23 ... Omnidirectional camera, 24 (24a-24d) ... Directional microphone, 24X ... Microphone array, 25 (25a-25d) ... Directional speaker, 25X ... Speaker array, 30 ... Monitor ECU (sound collecting unit, occupant detection unit, conversation determination unit, speaker identification unit, seating position identification unit, sound source identification unit, coincidence determination unit, and selection collection output unit), 31 ... in-car conversation support device, 40 ... Crew, 41 ... first occupant, 42 Second passenger, 51 ... speaker, 52 ... listener, 55 ... noise filter, IP ... captured image, IS, IST ... sound information.

Claims

A sound collection unit that collects sound information in the passenger compartment;
An occupant detection unit for detecting an occupant in the vehicle interior;
A conversation determination unit that determines whether or not the sound information indicates a conversation of an occupant detected in the vehicle interior;
A speaker identifying unit that identifies a speaker of the conversation when the sound information indicates the conversation of the occupant;
A selective collection output unit for selectively collecting and outputting the voice of the speaker;
A vehicle interior conversation support device.
The vehicle interior conversation support device according to claim 1,
A seating position specifying unit for specifying the seating position of the occupant in the passenger compartment;
A sound source identifying unit that identifies a sound source of the sound information;
A match determination unit that determines whether a sound source of the sound information matches the seating position of any occupant detected in the vehicle interior;
The in-vehicle conversation support device, wherein the speaker identification unit identifies the occupant as the utterer of the conversation when a sound source of the sound information matches a seating position of any of the occupants.
The in-vehicle conversation support device according to claim 2,
A microphone array provided in the vehicle interior having a plurality of directional microphones facing different directions;
The sound source specifying unit specifies a sound source direction of the sound information based on a position where the microphone array is provided based on an input level of each directional microphone,
The match determination unit determines that the seating position of the occupant matches the sound source when the seating position of the occupant is in the sound source direction of the sound information.
A vehicle interior conversation support device.
The in-vehicle conversation support device according to claim 1 or 2,
It further comprises a plurality of directional microphones provided in the vehicle interior in directions different from each other,
The selective collection output unit selects a directional microphone facing the direction of the speaker from the plurality of directional microphones and collects the voice of the speaker using the selected directional microphone. A vehicle interior conversation support device.
The in-vehicle conversation support device according to any one of claims 1 to 4,
It further comprises a plurality of directional speakers provided in the vehicle interior in directions different from each other,
The selective collection output unit directs the selectively collected voice of the speaker toward the direction of a passenger other than the speaker detected in the passenger compartment among the plurality of directional speakers. A vehicle interior conversation support device characterized by outputting from a speaker.
A vehicle interior conversation support device according to any one of claims 1 to 5,
A vehicle interior conversation support device, further comprising a noise filter for attenuating noise other than voice included in the sound information.
In the vehicle interior conversation support device according to any one of claims 1 to 6,
The vehicle interior conversation support device, wherein the vehicle occupant detection unit detects a vehicle occupant based on a photographed image captured by a camera provided in the vehicle interior.
The vehicle interior conversation support device according to any one of claims 1 to 7,
The passenger occupant detecting unit detects an occupant in a vehicle interior based on an output of a seating sensor provided on a seat in the vehicle interior.