JP4847022B2 - 発声内容認識装置 - Google Patents
発声内容認識装置 Download PDFInfo
- Publication number
- JP4847022B2 JP4847022B2 JP2005020813A JP2005020813A JP4847022B2 JP 4847022 B2 JP4847022 B2 JP 4847022B2 JP 2005020813 A JP2005020813 A JP 2005020813A JP 2005020813 A JP2005020813 A JP 2005020813A JP 4847022 B2 JP4847022 B2 JP 4847022B2
- Authority
- JP
- Japan
- Prior art keywords
- recognition
- mouth
- voice
- sound
- unit
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
- 238000011156 evaluation Methods 0.000 claims description 22
- 230000007704 transition Effects 0.000 claims description 20
- 230000005236 sound signal Effects 0.000 claims description 4
- 238000000034 method Methods 0.000 description 31
- 230000008569 process Effects 0.000 description 30
- 230000006870 function Effects 0.000 description 24
- 238000005259 measurement Methods 0.000 description 16
- 230000010354 integration Effects 0.000 description 9
- 238000001514 detection method Methods 0.000 description 6
- 238000003909 pattern recognition Methods 0.000 description 5
- 238000000605 extraction Methods 0.000 description 4
- 230000008859 change Effects 0.000 description 3
- 238000010586 diagram Methods 0.000 description 3
- 239000000284 extract Substances 0.000 description 3
- 230000003252 repetitive effect Effects 0.000 description 2
- 125000002066 L-histidyl group Chemical group [H]N1C([H])=NC(C([H])([H])[C@](C(=O)[*])([H])N([H])[H])=C1[H] 0.000 description 1
- 238000013528 artificial neural network Methods 0.000 description 1
- 230000004044 response Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/28—Constructional details of speech recognition systems
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/24—Speech recognition using non-acoustical features
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/20—Speech recognition techniques specially adapted for robustness in adverse environments, e.g. in noise, of stress induced speech
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L21/00—Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
- G10L21/02—Speech enhancement, e.g. noise reduction or echo cancellation
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L25/00—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00
- G10L25/78—Detection of presence or absence of voice signals
Landscapes
- Engineering & Computer Science (AREA)
- Computational Linguistics (AREA)
- Health & Medical Sciences (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- Acoustics & Sound (AREA)
- Multimedia (AREA)
- Quality & Reliability (AREA)
- Signal Processing (AREA)
- Image Analysis (AREA)
- Image Processing (AREA)
- Studio Devices (AREA)
Description
Claims (4)
- 収音する収音手段と、
前記収音手段に対し音声を発する発声者の口元を示す口元画像を撮影する撮影手段と、
前記収音手段により収音される音声から抽出される特徴パターンに基づいて、該発声者が発した音声を含む音声を、該発声者が発した音声である音声信号とその他の雑音信号とに分離し、該分離された音声信号および雑音信号に基づく収音状態の良さを示す収音状態評価値を取得する収音状態評価値取得手段と、
前記収音される音声に基づく音声認識を行う音声認識手段と、
前記撮影される画像に含まれる前記口元画像により示される発声者の口元の形状又は該形状の推移に基づいて口元認識を行う口元認識手段と、
前記収音状態評価値に応じて、前記音声認識手段又は前記口元認識手段のいずれにより認識を行うか決定する決定手段と、
を含むことを特徴とする発声内容認識装置。 - 請求項1に記載の発声内容認識装置において、
前記決定手段は、前記収音状態評価値が、第1の閾値以下である場合は前記口元認識手段により認識を行い、該第1の閾値を超え第2の閾値以下である場合は前記音声認識手段と前記口元認識手段とにより認識を行い、該第2の閾値を超える場合は前記音声認識手段により認識を行う、
ことを特徴とする発声内容認識装置。 - 請求項1または2に記載の発声内容認識装置において、
前記撮影される前記口元画像により示される口元に向けて、前記収音手段の指向性を合わせる音声指向性制御手段、
をさらに含むことを特徴とする発声内容認識装置。 - 請求項1乃至3のいずれか一項に記載の発声内容認識装置において、
前記収音される音声に基づく前記音声認識手段の認識結果と、該音声の発声者が該音声を発する際の前記撮影される画像に含まれる口元画像により示される口元の形状又は該形状の推移と、に基づいて、前記口元認識手段による口元認識の学習を行う口元認識学習手段、
をさらに含むことを特徴とする発声内容認識装置。
Priority Applications (5)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2005020813A JP4847022B2 (ja) | 2005-01-28 | 2005-01-28 | 発声内容認識装置 |
CN200580047250XA CN101111886B (zh) | 2005-01-28 | 2005-12-19 | 发声内容识别装置与发声内容识别方法 |
KR1020077017296A KR100931418B1 (ko) | 2005-01-28 | 2005-12-19 | 발성 내용 인식 장치 및 발성 내용 인식 방법 |
US11/814,794 US7979276B2 (en) | 2005-01-28 | 2005-12-19 | Speech recognition apparatus and speech recognition method |
PCT/JP2005/023295 WO2006080161A1 (ja) | 2005-01-28 | 2005-12-19 | 発声内容認識装置及び発声内容認識方法 |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2005020813A JP4847022B2 (ja) | 2005-01-28 | 2005-01-28 | 発声内容認識装置 |
Related Child Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
JP2010287127A Division JP5465166B2 (ja) | 2010-12-24 | 2010-12-24 | 発声内容認識装置および発声内容認識方法 |
Publications (2)
Publication Number | Publication Date |
---|---|
JP2006208751A JP2006208751A (ja) | 2006-08-10 |
JP4847022B2 true JP4847022B2 (ja) | 2011-12-28 |
Family
ID=36740194
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
JP2005020813A Expired - Fee Related JP4847022B2 (ja) | 2005-01-28 | 2005-01-28 | 発声内容認識装置 |
Country Status (5)
Country | Link |
---|---|
US (1) | US7979276B2 (ja) |
JP (1) | JP4847022B2 (ja) |
KR (1) | KR100931418B1 (ja) |
CN (1) | CN101111886B (ja) |
WO (1) | WO2006080161A1 (ja) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US11551682B2 (en) | 2018-12-14 | 2023-01-10 | Samsung Electronics Co., Ltd. | Method of performing function of electronic device and electronic device using same |
Families Citing this family (25)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP4715738B2 (ja) * | 2006-12-19 | 2011-07-06 | トヨタ自動車株式会社 | 発話検出装置及び発話検出方法 |
US8856002B2 (en) * | 2007-04-12 | 2014-10-07 | International Business Machines Corporation | Distance metrics for universal pattern processing tasks |
CN101656070B (zh) * | 2008-08-22 | 2012-01-04 | 展讯通信(上海)有限公司 | 一种语音检测方法 |
US20140098233A1 (en) * | 2012-10-05 | 2014-04-10 | Sensormatic Electronics, LLC | Access Control Reader with Audio Spatial Filtering |
KR102091003B1 (ko) * | 2012-12-10 | 2020-03-19 | 삼성전자 주식회사 | 음성인식 기술을 이용한 상황 인식 서비스 제공 방법 및 장치 |
JP5902632B2 (ja) | 2013-01-07 | 2016-04-13 | 日立マクセル株式会社 | 携帯端末装置及び情報処理システム |
US9747900B2 (en) * | 2013-05-24 | 2017-08-29 | Google Technology Holdings LLC | Method and apparatus for using image data to aid voice recognition |
KR102282366B1 (ko) | 2013-06-03 | 2021-07-27 | 삼성전자주식회사 | 음성 향상 방법 및 그 장치 |
US9564128B2 (en) * | 2013-12-09 | 2017-02-07 | Qualcomm Incorporated | Controlling a speech recognition process of a computing device |
CN103745723A (zh) * | 2014-01-13 | 2014-04-23 | 苏州思必驰信息科技有限公司 | 一种音频信号识别方法及装置 |
CN104376250A (zh) * | 2014-12-03 | 2015-02-25 | 优化科技(苏州)有限公司 | 基于音型像特征的真人活体身份验证方法 |
DE112014007265T5 (de) * | 2014-12-18 | 2017-09-07 | Mitsubishi Electric Corporation | Spracherkennungseinrichtung und Spracherkennungsverfahren |
CN104537358A (zh) * | 2014-12-26 | 2015-04-22 | 安徽寰智信息科技股份有限公司 | 基于深度学习的唇语识别唇形训练数据库的生成方法 |
CN104484656A (zh) * | 2014-12-26 | 2015-04-01 | 安徽寰智信息科技股份有限公司 | 基于深度学习的唇语识别唇形模型库构建方法 |
CN104834900B (zh) * | 2015-04-15 | 2017-12-19 | 常州飞寻视讯信息科技有限公司 | 一种联合声像信号进行活体检测的方法和系统 |
US9875081B2 (en) * | 2015-09-21 | 2018-01-23 | Amazon Technologies, Inc. | Device selection for providing a response |
JP6190909B2 (ja) * | 2016-03-10 | 2017-08-30 | 日立マクセル株式会社 | 携帯端末装置及び情報処理システム |
JP7056020B2 (ja) * | 2017-07-04 | 2022-04-19 | 富士フイルムビジネスイノベーション株式会社 | 情報処理装置およびプログラム |
US10482904B1 (en) | 2017-08-15 | 2019-11-19 | Amazon Technologies, Inc. | Context driven device arbitration |
US10522147B2 (en) * | 2017-12-21 | 2019-12-31 | Motorola Solutions, Inc. | Device and method for generating text representative of lip movement |
JP6535783B1 (ja) * | 2018-04-23 | 2019-06-26 | 和夫 金子 | 接客支援システム |
EP3829901A1 (en) | 2018-08-02 | 2021-06-09 | Pirelli Tyre S.p.A. | Tyre comprising a monitoring device |
US11094327B2 (en) * | 2018-09-28 | 2021-08-17 | Lenovo (Singapore) Pte. Ltd. | Audible input transcription |
CN109949812A (zh) * | 2019-04-26 | 2019-06-28 | 百度在线网络技术(北京)有限公司 | 一种语音交互方法、装置、设备及存储介质 |
CN113345472B (zh) * | 2021-05-08 | 2022-03-25 | 北京百度网讯科技有限公司 | 语音端点检测方法、装置、电子设备及存储介质 |
Family Cites Families (25)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPS6433599A (en) * | 1987-07-29 | 1989-02-03 | Oki Electric Ind Co Ltd | Voice recognition equipment |
JPH01195499A (ja) * | 1988-01-30 | 1989-08-07 | Toshiba Corp | 音声入力装置 |
JPH03129400A (ja) * | 1989-10-13 | 1991-06-03 | Seiko Epson Corp | 音声認識装置 |
JPH05188993A (ja) * | 1991-12-19 | 1993-07-30 | Tokico Ltd | 音声認識装置 |
DE4212907A1 (de) * | 1992-04-05 | 1993-10-07 | Drescher Ruediger | Spracherkennungsverfahren für Datenverarbeitungssysteme u.s.w. |
JP3113449B2 (ja) | 1993-04-21 | 2000-11-27 | 京セラ株式会社 | 画像認識ダイヤル装置 |
US6471420B1 (en) * | 1994-05-13 | 2002-10-29 | Matsushita Electric Industrial Co., Ltd. | Voice selection apparatus voice response apparatus, and game apparatus using word tables from which selected words are output as voice selections |
JP3729918B2 (ja) * | 1995-07-19 | 2005-12-21 | 株式会社東芝 | マルチモーダル対話装置及び対話方法 |
US5729694A (en) * | 1996-02-06 | 1998-03-17 | The Regents Of The University Of California | Speech coding, reconstruction and recognition using acoustics and electromagnetic waves |
JP3702978B2 (ja) * | 1996-12-26 | 2005-10-05 | ソニー株式会社 | 認識装置および認識方法、並びに学習装置および学習方法 |
JP3798530B2 (ja) * | 1997-09-05 | 2006-07-19 | 松下電器産業株式会社 | 音声認識装置及び音声認識方法 |
US6594629B1 (en) * | 1999-08-06 | 2003-07-15 | International Business Machines Corporation | Methods and apparatus for audio-visual speech detection and recognition |
US6219640B1 (en) * | 1999-08-06 | 2001-04-17 | International Business Machines Corporation | Methods and apparatus for audio-visual speaker recognition and utterance verification |
US6219645B1 (en) * | 1999-12-02 | 2001-04-17 | Lucent Technologies, Inc. | Enhanced automatic speech recognition using multiple directional microphones |
EP1255665B1 (de) * | 2000-02-04 | 2007-09-12 | Continental Teves AG & Co. oHG | Verfahren und schaltungsanordnung zur steuerung einer blockiergeschützten bremsanlage für kraftfahrzeuge mit allradantrieb |
JP2002169586A (ja) * | 2000-09-19 | 2002-06-14 | Atr Onsei Gengo Tsushin Kenkyusho:Kk | 音声及び画像の合成モデル生成装置、音声及び画像の合成モデルのための環境適応化装置、並びに音声認識装置 |
JP4624577B2 (ja) * | 2001-02-23 | 2011-02-02 | 富士通株式会社 | 複数のセンサによるヒューマンインタフェースシステム |
JP4675514B2 (ja) * | 2001-07-16 | 2011-04-27 | シャープ株式会社 | 音声処理装置、音声処理方法、及びその方法を実施するためのプログラムを記録したコンピュータにより読取り可能な記録媒体 |
JP2003255993A (ja) * | 2002-03-04 | 2003-09-10 | Ntt Docomo Inc | 音声認識システム、音声認識方法、音声認識プログラム、音声合成システム、音声合成方法、音声合成プログラム |
JP3891023B2 (ja) * | 2002-04-01 | 2007-03-07 | 日本電気株式会社 | 通訳システム及びプログラム |
JP2004240154A (ja) * | 2003-02-06 | 2004-08-26 | Hitachi Ltd | 情報認識装置 |
JP2004246095A (ja) * | 2003-02-14 | 2004-09-02 | Nec Saitama Ltd | 携帯電話装置及び遠隔制御方法 |
US7343289B2 (en) * | 2003-06-25 | 2008-03-11 | Microsoft Corp. | System and method for audio/video speaker detection |
US7269560B2 (en) * | 2003-06-27 | 2007-09-11 | Microsoft Corporation | Speech detection and enhancement using audio/video fusion |
US20060227237A1 (en) * | 2005-03-31 | 2006-10-12 | International Business Machines Corporation | Video surveillance system and method with combined video and audio recognition |
-
2005
- 2005-01-28 JP JP2005020813A patent/JP4847022B2/ja not_active Expired - Fee Related
- 2005-12-19 CN CN200580047250XA patent/CN101111886B/zh not_active Expired - Fee Related
- 2005-12-19 US US11/814,794 patent/US7979276B2/en not_active Expired - Fee Related
- 2005-12-19 KR KR1020077017296A patent/KR100931418B1/ko not_active IP Right Cessation
- 2005-12-19 WO PCT/JP2005/023295 patent/WO2006080161A1/ja not_active Application Discontinuation
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US11551682B2 (en) | 2018-12-14 | 2023-01-10 | Samsung Electronics Co., Ltd. | Method of performing function of electronic device and electronic device using same |
Also Published As
Publication number | Publication date |
---|---|
US7979276B2 (en) | 2011-07-12 |
JP2006208751A (ja) | 2006-08-10 |
CN101111886A (zh) | 2008-01-23 |
WO2006080161A1 (ja) | 2006-08-03 |
KR100931418B1 (ko) | 2009-12-11 |
KR20070090264A (ko) | 2007-09-05 |
CN101111886B (zh) | 2011-11-16 |
US20090018831A1 (en) | 2009-01-15 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
JP4847022B2 (ja) | 発声内容認識装置 | |
JP4204541B2 (ja) | 対話型ロボット、対話型ロボットの音声認識方法および対話型ロボットの音声認識プログラム | |
JP4729927B2 (ja) | 音声検出装置、自動撮像装置、および音声検出方法 | |
JP6230726B2 (ja) | 音声認識装置および音声認識方法 | |
JP4715738B2 (ja) | 発話検出装置及び発話検出方法 | |
US9330673B2 (en) | Method and apparatus for performing microphone beamforming | |
WO2019044157A1 (ja) | 収音装置、収音方法、及びプログラム | |
JP2006251266A (ja) | 視聴覚連携認識方法および装置 | |
JP2007507783A (ja) | 生体測定閾値を適応的に設定するシステム及び方法 | |
WO2012020591A1 (ja) | 個体識別システム、特徴量特定装置、特徴量特定方法および記録媒体 | |
KR100827080B1 (ko) | 사용자 인식 기반의 빔 포밍 장치 및 방법 | |
JP2007257088A (ja) | ロボット装置及びそのコミュニケーション方法 | |
JP5465166B2 (ja) | 発声内容認識装置および発声内容認識方法 | |
JP6607092B2 (ja) | 案内ロボット制御システム、プログラム及び案内ロボット | |
JP2001067098A (ja) | 人物検出方法と人物検出機能搭載装置 | |
CN110653812B (zh) | 一种机器人的交互方法、机器人及具有存储功能的装置 | |
JP6916130B2 (ja) | 話者推定方法および話者推定装置 | |
KR20210039583A (ko) | 멀티모달 기반 사용자 구별 방법 및 장치 | |
JP2020086034A (ja) | 情報処理装置、情報処理装置およびプログラム | |
JP4781248B2 (ja) | 撮像装置、撮像装置の制御方法、プログラム及び記録媒体 | |
JP2007155985A (ja) | ロボットおよび音声認識装置ならびにその方法 | |
CN110033790B (zh) | 声音认识装置、机器人、声音认识方法以及记录介质 | |
EP4178220A1 (en) | Voice-input device | |
JP7026812B2 (ja) | 情報処理装置及び情報処理方法 | |
CN112948792A (zh) | 一种解锁方法及装置 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
A621 | Written request for application examination |
Free format text: JAPANESE INTERMEDIATE CODE: A621 Effective date: 20071217 |
|
A131 | Notification of reasons for refusal |
Free format text: JAPANESE INTERMEDIATE CODE: A131 Effective date: 20100601 |
|
A521 | Request for written amendment filed |
Free format text: JAPANESE INTERMEDIATE CODE: A523 Effective date: 20100730 |
|
A131 | Notification of reasons for refusal |
Free format text: JAPANESE INTERMEDIATE CODE: A131 Effective date: 20101102 |
|
A521 | Request for written amendment filed |
Free format text: JAPANESE INTERMEDIATE CODE: A523 Effective date: 20101228 |
|
A02 | Decision of refusal |
Free format text: JAPANESE INTERMEDIATE CODE: A02 Effective date: 20110301 |
|
A521 | Request for written amendment filed |
Free format text: JAPANESE INTERMEDIATE CODE: A523 Effective date: 20110601 |
|
A911 | Transfer to examiner for re-examination before appeal (zenchi) |
Free format text: JAPANESE INTERMEDIATE CODE: A911 Effective date: 20110610 |
|
TRDD | Decision of grant or rejection written | ||
A01 | Written decision to grant a patent or to grant a registration (utility model) |
Free format text: JAPANESE INTERMEDIATE CODE: A01 Effective date: 20111004 |
|
A01 | Written decision to grant a patent or to grant a registration (utility model) |
Free format text: JAPANESE INTERMEDIATE CODE: A01 |
|
A61 | First payment of annual fees (during grant procedure) |
Free format text: JAPANESE INTERMEDIATE CODE: A61 Effective date: 20111013 |
|
FPAY | Renewal fee payment (event date is renewal date of database) |
Free format text: PAYMENT UNTIL: 20141021 Year of fee payment: 3 |
|
R150 | Certificate of patent or registration of utility model |
Free format text: JAPANESE INTERMEDIATE CODE: R150 Ref document number: 4847022 Country of ref document: JP Free format text: JAPANESE INTERMEDIATE CODE: R150 |
|
R250 | Receipt of annual fees |
Free format text: JAPANESE INTERMEDIATE CODE: R250 |
|
R250 | Receipt of annual fees |
Free format text: JAPANESE INTERMEDIATE CODE: R250 |
|
R250 | Receipt of annual fees |
Free format text: JAPANESE INTERMEDIATE CODE: R250 |
|
LAPS | Cancellation because of no payment of annual fees |