JP2010023639A - In-cabin conversation assisting device - Google Patents

In-cabin conversation assisting device Download PDF

Info

Publication number
JP2010023639A
JP2010023639A JP2008186791A JP2008186791A JP2010023639A JP 2010023639 A JP2010023639 A JP 2010023639A JP 2008186791 A JP2008186791 A JP 2008186791A JP 2008186791 A JP2008186791 A JP 2008186791A JP 2010023639 A JP2010023639 A JP 2010023639A
Authority
JP
Japan
Prior art keywords
conversation
speaker
microphone
seat
vehicle
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
JP2008186791A
Other languages
Japanese (ja)
Inventor
Takuya Abe
卓也 阿部
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Kenwood KK
Original Assignee
Kenwood KK
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Kenwood KK filed Critical Kenwood KK
Priority to JP2008186791A priority Critical patent/JP2010023639A/en
Publication of JP2010023639A publication Critical patent/JP2010023639A/en
Pending legal-status Critical Current

Links

Images

Landscapes

  • Circuit For Audible Band Transducer (AREA)
  • Fittings On The Vehicle Exterior For Carrying Loads, And Devices For Holding Or Mounting Articles (AREA)

Abstract

<P>PROBLEM TO BE SOLVED: To provide an in-cabin conversation assisting device usable merely by sounding out for a conversation without operating a switch. <P>SOLUTION: The in-cabin conversation assisting device includes a microphone 3 detecting the voice of an occupant in each seat 6 and a speaker outputting the output signal of the microphone 3 as a sound. It further includes a camera 2 photographing the motion of the mouth of the occupant in each seat, and an image recognition device recognizing the motion of the mouth during the conversation from images photographed by the camera 2. When the speaker of the conversation is specified by the image recognition device, the output signal of the microphone is output as the sound. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

この発明は車両内で容易に会話ができるようにする車内会話補助装置に関する。   The present invention relates to an in-vehicle conversation assisting device that enables easy conversation in a vehicle.

従来の特開平１１−３４２７９９号公報に開示された車両用会話支援装置は、各座席毎に会話スイッチを配置し、各座席に着座した人が会話スイッチを操作して自分の声をマイクロホンに吹き込み目的とする座席の近傍に配置してスピーカを発音させる。
特開平１１−３４２７９９号公報、段落００５１〜段落００５２、図３ In the conventional conversation support device for a vehicle disclosed in Japanese Patent Application Laid-Open No. 11-342799, a conversation switch is arranged for each seat, and a person seated in each seat operates the conversation switch to blow his / her voice into the microphone. Place the speaker in the vicinity of the target seat to make the speaker sound.
Japanese Patent Laid-Open No. 11-342799, paragraphs 0051 to 0052, FIG.

上記した特開平１１−３４２７９９号公報に開示された車両用会話支援装置は、会話するときに一々会話スイッチを操作する必要があり面倒である。そして、操作方法を知らないと利用できないという問題があった。   The above-described conversation support device for a vehicle disclosed in Japanese Patent Application Laid-Open No. 11-342799 is troublesome because it is necessary to operate a conversation switch one by one when talking. And there was a problem that it cannot be used without knowing the operation method.

この発明は上記した点に鑑みてなされたものであって、その目的とするところは、会話スイッチを操作する必要がなく、単に発音するだけで利用できる車内会話補助装置を提供することにある。   The present invention has been made in view of the above points, and an object of the present invention is to provide an in-vehicle conversation assisting device that can be used simply by sounding without having to operate a conversation switch.

この発明の車内会話補助装置は、各座席の乗員の声を検出するマイクロホンと、前記マイクロホンの出力信号を音声として出力するスピーカを備えた車内会話補助装置において、前記各座席の乗員の口の動きを撮影するカメラと、前記カメラで撮影した映像から会話中の口の動きを認識する画像認識装置を備え、前記画像認識装置により会話の話者が特定されると、前記マイクロホンの出力信号を音声として出力するものである。   The in-vehicle conversation assisting device according to the present invention is an in-car conversation assisting device including a microphone that detects a voice of an occupant in each seat and a speaker that outputs an output signal of the microphone as sound. And an image recognition device for recognizing the movement of the mouth during conversation from the video captured by the camera, and when the speaker of the conversation is specified by the image recognition device, the output signal of the microphone is Is output as

また、前記車内会話補助装置において、車載用音響装置のスピーカを前記マイクロホンの出力信号を音声として出力するスピーカとして利用すると共に、前記画像認識装置により会話の話者を特定したときはオーディオの音量を下げると共に、会話の話者近傍のスピーカの音量を下げるものである。   In the in-car conversation assisting device, the speaker of the in-vehicle acoustic device is used as a speaker for outputting the output signal of the microphone as sound, and the audio volume is set when the speaker of the conversation is specified by the image recognition device. While lowering, the volume of the speaker near the speaker of the conversation is lowered.

また、前記各車内会話補助装置において、前記マイクロホンを各座席の乗員の近傍に配置し、前記特定された話者近傍のマイクロホンの出力のみを有効とするものである。   Further, in each of the in-vehicle conversation assisting devices, the microphone is disposed in the vicinity of an occupant in each seat, and only the output of the microphone in the vicinity of the specified speaker is validated.

この発明の車内会話補助装置によれば、会話スイッチを操作する必要がなく、単に発音するだけで利用できるので、利用者は装置の使用方法を知らなくても、単に話しをするだけで装置を使用できて使い勝手がよい。   According to the in-vehicle conversation assisting device of the present invention, it is not necessary to operate the conversation switch, and it can be used simply by sounding. Therefore, even if the user does not know how to use the device, the user can simply speak to It is usable and is convenient.

以下この発明を実施するための最良の形態を実施例に即して説明する。図１はこの発明の実施例である車内会話補助装置の概略構成を示す図、図２は同車内会話補助装置を示すブロック図である。   The best mode for carrying out the present invention will be described below with reference to examples. FIG. 1 is a diagram showing a schematic configuration of an in-car conversation assisting apparatus according to an embodiment of the present invention, and FIG. 2 is a block diagram showing the in-car conversation assisting apparatus.

図１に示すカメラ２としてＣＣＤカメラが用いられており、各座席６、６…の乗員の顔を撮影できる位置に配置されている。マイクロホン３は、各乗員から発せられる音声を集音できる位置に配置されている。カメラ２およびマイクロホン３の出力信号は判定・制御部１に入力される。   A CCD camera is used as the camera 2 shown in FIG. 1, and is arranged at a position where the faces of the passengers in the seats 6, 6. The microphone 3 is disposed at a position where sound emitted from each occupant can be collected. Output signals from the camera 2 and the microphone 3 are input to the determination / control unit 1.

判定・制御部１はマイクロホン３からの音声信号と、カメラ２の画像を解析して生成した制御信号を図２に示す車載用音響装置４に出力する。車載用音響装置４はディスプレー装置を備えており、ナビゲーション機能を有する。また、車載用音響装置４が駆動するスピーカは各座席の近傍に夫々配置されている。   The determination / control unit 1 outputs the audio signal from the microphone 3 and the control signal generated by analyzing the image of the camera 2 to the in-vehicle acoustic device 4 shown in FIG. The in-vehicle acoustic device 4 includes a display device and has a navigation function. The speakers driven by the in-vehicle acoustic device 4 are arranged in the vicinity of each seat.

次に判定・制御部１の動作を説明する。判定・制御部１はカメラ２から入力された映像信号を動画のパターンとして認識するが、人間の顔の画像パターンと発語の口の動画パターを備えており、それと比較することにより、各座席の人の顔の口の部分の画像を特定し、撮影した各人の口の動きの動画パターンから話しをしている人を特定する。   Next, the operation of the determination / control unit 1 will be described. The determination / control unit 1 recognizes the video signal input from the camera 2 as a moving image pattern, and includes a human face image pattern and a spoken mouth moving image pattern. The image of the mouth part of the person's face is identified, and the person who is talking is identified from the moving image pattern of each person's mouth movement.

口の動きは食事しているときと話しているときとで動画パターンは大きく異なっているため、話している人を特定することができる。話者を特定すると、判定・制御部１は車載用音響装置４に指令して、オーディオの音量を下げると共にマイクロホン３からの信号を車載用音響装置４に出力してスピーカ５から発音させる。このとき、特定した話者の近傍のスピーカ５の音量を下げさせる。これにより話者は自分の話した声が大きく聞こえる不快感を感じない。   Since the movement of the mouth is greatly different between when eating and talking, the person who is talking can be identified. When the speaker is specified, the determination / control unit 1 instructs the in-vehicle acoustic device 4 to reduce the volume of the audio and output a signal from the microphone 3 to the in-vehicle acoustic device 4 to generate sound from the speaker 5. At this time, the volume of the speaker 5 near the specified speaker is lowered. As a result, the speaker does not feel uncomfortable with the loudness of his voice.

実施例は以上のように構成されているが発明はこれに限られず、例えば、受発信機能を有しＩＤ番号が割り当てられデジタル音声信号を発信するワイヤレスマイクロホンを各座席の近傍に配置し、判定・制御部１に受発信機能を持たせ、話者を特定すると、それにより特定されたＩＤ番号を発信し、話者近傍のワイヤレスマイクロホンのみ音声信号を送信させるようにしてもよい。こうすることにより、会話の音声をより明瞭に聞けるようになる。   The embodiment is configured as described above, but the invention is not limited to this. For example, a wireless microphone that has a transmission / reception function and is assigned an ID number and transmits a digital audio signal is arranged in the vicinity of each seat for determination. The control unit 1 may be provided with a transmission / reception function, and when a speaker is specified, an ID number specified thereby may be transmitted, and an audio signal may be transmitted only to a wireless microphone near the speaker. By doing so, the voice of the conversation can be heard more clearly.

上記のＩＤ番号を使用する代わりに、各座席のワイヤレスマイクロホンの送信周波数を異ならせ、特定した話者のワイヤレスマイクロホンの送信周波数のみを判定・制御部が受信するようにしてもよい。   Instead of using the above ID number, the transmission frequency of the wireless microphone of each seat may be varied so that the determination / control unit receives only the transmission frequency of the wireless microphone of the identified speaker.

この発明の実施例である車内会話補助装置の概略構成を示す図である。It is a figure which shows schematic structure of the in-vehicle conversation assistance apparatus which is an Example of this invention. 同車内会話補助装置を示すブロック図である。It is a block diagram which shows the same-car conversation assistance apparatus.

符号の説明Explanation of symbols

１ 判定・制御部
２ カメラ
３ マイクロホン
４ 車載用音響装置
５ スピーカ
６ 座席 DESCRIPTION OF SYMBOLS 1 Judgment / control part 2 Camera 3 Microphone 4 Car audio system 5 Speaker 6 Seat

Claims (3)

各座席の乗員の声を検出するマイクロホンと、前記マイクロホンの出力信号を音声として出力するスピーカを備えた車内会話補助装置において、前記各座席の乗員の口の動きを撮影するカメラと、前記カメラで撮影した映像から会話中の口の動きを認識する画像認識装置を備え、前記画像認識装置により会話の話者が特定されると、前記マイクロホンの出力信号を音声として出力することを特徴とする車内会話補助装置。 In the in-vehicle conversation assisting device including a microphone for detecting a voice of an occupant of each seat and a speaker for outputting an output signal of the microphone as a voice, a camera for photographing a movement of an occupant's mouth of each seat, and the camera An image recognition device for recognizing a mouth movement during a conversation from a photographed image, and outputting an output signal of the microphone as a sound when a speaker of the conversation is specified by the image recognition device. Conversation assist device. 車載用音響装置のスピーカを前記マイクロホンの出力信号を音声として出力するスピーカとして利用すると共に、前記画像認識装置により会話の話者を特定したときはオーディオの音量を下げると共に、会話の話者近傍のスピーカの音量を下げることを特徴とする請求項１の車内会話補助装置。 The speaker of the in-vehicle acoustic device is used as a speaker that outputs the output signal of the microphone as sound, and when the speaker of conversation is specified by the image recognition device, the volume of the audio is lowered and the speaker near the speaker of conversation is The in-vehicle conversation assisting device according to claim 1, wherein the volume of the speaker is lowered. 前記マイクロホンを各座席の乗員の近傍に配置し、前記特定された話者近傍のマイクロホンの出力のみを有効とする請求項１または２の車内会話補助装置。 The in-vehicle conversation assistance device according to claim 1 or 2, wherein the microphone is arranged in the vicinity of a passenger in each seat and only the output of the microphone in the vicinity of the specified speaker is valid.
JP2008186791A 2008-07-18 2008-07-18 In-cabin conversation assisting device Pending JP2010023639A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP2008186791A JP2010023639A (en) 2008-07-18 2008-07-18 In-cabin conversation assisting device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
JP2008186791A JP2010023639A (en) 2008-07-18 2008-07-18 In-cabin conversation assisting device

Publications (1)

Publication Number Publication Date
JP2010023639A true JP2010023639A (en) 2010-02-04

Family

ID=41729863

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2008186791A Pending JP2010023639A (en) 2008-07-18 2008-07-18 In-cabin conversation assisting device

Country Status (1)

Country Link
JP (1) JP2010023639A (en)

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2012186622A (en) * 2011-03-04 2012-09-27 Sony Corp Information processing apparatus, information processing method, and program
WO2017183372A1 (en) * 2016-04-18 2017-10-26 アイシン精機 株式会社 Vehicle interior conversion assist device
US20190037363A1 (en) * 2017-07-31 2019-01-31 GM Global Technology Operations LLC Vehicle based acoustic zoning system for smartphones
KR20190031053A (en) * 2017-09-15 2019-03-25 엘지전자 주식회사 Vehicle control method
WO2020088486A1 (en) * 2018-11-02 2020-05-07 Ningbo Geely Automobile Research & Development Co., Ltd. Audio communication in a vehicle
JPWO2021038736A1 (en) * 2019-08-28 2021-03-04
US11599767B2 (en) 2018-04-04 2023-03-07 Toyota Motor Engineering & Manufacturing North America, Inc. Automotive virtual personal assistant

Cited By (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2012186622A (en) * 2011-03-04 2012-09-27 Sony Corp Information processing apparatus, information processing method, and program
WO2017183372A1 (en) * 2016-04-18 2017-10-26 アイシン精機 株式会社 Vehicle interior conversion assist device
US20190037363A1 (en) * 2017-07-31 2019-01-31 GM Global Technology Operations LLC Vehicle based acoustic zoning system for smartphones
KR20190031053A (en) * 2017-09-15 2019-03-25 엘지전자 주식회사 Vehicle control method
KR102023995B1 (en) * 2017-09-15 2019-09-23 엘지전자 주식회사 Vehicle control method
US11599767B2 (en) 2018-04-04 2023-03-07 Toyota Motor Engineering & Manufacturing North America, Inc. Automotive virtual personal assistant
US11570567B2 (en) 2018-11-02 2023-01-31 Ningbo Geely Automobile Research & Development Co. Audio communication in a vehicle
WO2020088486A1 (en) * 2018-11-02 2020-05-07 Ningbo Geely Automobile Research & Development Co., Ltd. Audio communication in a vehicle
CN112913228B (en) * 2018-11-02 2023-09-08 宁波吉利汽车研究开发有限公司 In-car audio call
CN112913228A (en) * 2018-11-02 2021-06-04 宁波吉利汽车研究开发有限公司 In-car audio communication
JPWO2021038736A1 (en) * 2019-08-28 2021-03-04
JP6995254B2 (en) 2019-08-28 2022-01-14 三菱電機株式会社 Sound field control device and sound field control method
WO2021038736A1 (en) * 2019-08-28 2021-03-04 三菱電機株式会社 Sound field control device and sound field control method

Similar Documents

Publication Publication Date Title
US10536791B2 (en) Vehicular sound processing system
JP2010023639A (en) In-cabin conversation assisting device
KR101337145B1 (en) Vehicle Communication System
JP4779748B2 (en) Voice input / output device for vehicle and program for voice input / output device
CN108141663B (en) Sound collecting device and control method of sound collecting device
JP6284331B2 (en) Conversation support device, conversation support method, and conversation support program
JP6466385B2 (en) Service providing apparatus, service providing method, and service providing program
JP2007219207A (en) Speech recognition device
JP2009124540A (en) Vehicle call device, and calling method
WO2017183372A1 (en) Vehicle interior conversion assist device
JP2014170154A (en) In-vehicle conversation support device
JP2009178783A (en) Communication robot and its control method
JP2004354930A (en) Speech recognition system
JP4478146B2 (en) Speech recognition system, speech recognition method and program thereof
JP7065964B2 (en) Sound field control device and sound field control method
JP4632974B2 (en) Car audio system
JP2005118248A (en) Sheet incorporating bone conduction microphone and loudspeaker
KR20130036492A (en) Rear communication system using for vehicle and method thereof
US20220210584A1 (en) Vehicle assistive hearing
JP6332072B2 (en) Dialogue device
JP2009253350A (en) Emergency reporting system terminal unit
JP7013407B2 (en) Vehicle management system
JP2018076035A (en) Conversation support device for vehicle
JP7163876B2 (en) In-vehicle conversation support device
JP2006188343A (en) Call registration device of elevator