JP2024516815A - エピソード的コンテンツをサポートする話者ダイアライゼーション - Google Patents

エピソード的コンテンツをサポートする話者ダイアライゼーション Download PDF

Info

Publication number
JP2024516815A
JP2024516815A JP2023565384A JP2023565384A JP2024516815A JP 2024516815 A JP2024516815 A JP 2024516815A JP 2023565384 A JP2023565384 A JP 2023565384A JP 2023565384 A JP2023565384 A JP 2023565384A JP 2024516815 A JP2024516815 A JP 2024516815A
Authority
JP
Japan
Prior art keywords
embeddings
speaker
media data
clustering
processor
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
JP2023565384A
Other languages
English (en)
Japanese (ja)
Other versions
JP2024516815A5 (cg-RX-API-DMAC7.html
Inventor
ファネッリ,アンドレア
ユイン,ミーンチーン
スレシュ パンキー,サテジ
ローレンス エンゲル,ニコラス
アン キャリー クラム,ポピー
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Dolby Laboratories Licensing Corp
Original Assignee
Dolby Laboratories Licensing Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Dolby Laboratories Licensing Corp filed Critical Dolby Laboratories Licensing Corp
Publication of JP2024516815A publication Critical patent/JP2024516815A/ja
Publication of JP2024516815A5 publication Critical patent/JP2024516815A5/ja
Pending legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F40/00—Handling natural language data
    • G06F40/30—Semantic analysis
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L25/00—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00
    • G10L25/78—Detection of presence or absence of voice signals
    • G10L25/84—Detection of presence or absence of voice signals for discriminating voice from noise
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L17/00—Speaker identification or verification techniques
    • G10L17/02—Preprocessing operations, e.g. segment selection; Pattern representation or modelling, e.g. based on linear discriminant analysis [LDA] or principal components; Feature selection or extraction
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L17/00—Speaker identification or verification techniques
    • G10L17/06—Decision making techniques; Pattern matching strategies
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L17/00—Speaker identification or verification techniques
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L17/00—Speaker identification or verification techniques
    • G10L17/18—Artificial neural networks; Connectionist approaches

Landscapes

  • Engineering & Computer Science (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Physics & Mathematics (AREA)
  • Health & Medical Sciences (AREA)
  • Multimedia (AREA)
  • Human Computer Interaction (AREA)
  • Acoustics & Sound (AREA)
  • Theoretical Computer Science (AREA)
  • Computational Linguistics (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • General Engineering & Computer Science (AREA)
  • Artificial Intelligence (AREA)
  • General Health & Medical Sciences (AREA)
  • General Physics & Mathematics (AREA)
  • Game Theory and Decision Science (AREA)
  • Business, Economics & Management (AREA)
  • Signal Processing (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
JP2023565384A 2021-04-30 2022-04-27 エピソード的コンテンツをサポートする話者ダイアライゼーション Pending JP2024516815A (ja)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US202163182338P 2021-04-30 2021-04-30
US63/182,338 2021-04-30
PCT/US2022/026552 WO2022232284A1 (en) 2021-04-30 2022-04-27 Speaker diarization supporting eposodical content

Publications (2)

Publication Number Publication Date
JP2024516815A true JP2024516815A (ja) 2024-04-17
JP2024516815A5 JP2024516815A5 (cg-RX-API-DMAC7.html) 2025-06-19

Family

ID=81748315

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2023565384A Pending JP2024516815A (ja) 2021-04-30 2022-04-27 エピソード的コンテンツをサポートする話者ダイアライゼーション

Country Status (5)

Country Link
US (1) US20240160849A1 (cg-RX-API-DMAC7.html)
EP (1) EP4330965B1 (cg-RX-API-DMAC7.html)
JP (1) JP2024516815A (cg-RX-API-DMAC7.html)
CN (1) CN117157708A (cg-RX-API-DMAC7.html)
WO (1) WO2022232284A1 (cg-RX-API-DMAC7.html)

Families Citing this family (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN117378007A (zh) * 2021-06-04 2024-01-09 索尼集团公司 信息处理装置、信号处理装置、信息处理方法和程序
US12198677B2 (en) * 2022-05-27 2025-01-14 Tencent America LLC Techniques for end-to-end speaker diarization with generalized neural speaker clustering
US12198720B2 (en) * 2022-06-10 2025-01-14 Spotify Ab Systems and methods for speaker diarization
US12579993B2 (en) * 2022-06-27 2026-03-17 Amazon Technologies, Inc. Multi-talker audio stream separation, transcription and diaraization
US12437776B2 (en) * 2022-09-19 2025-10-07 SubStrata Ltd. Automated classification of relative dominance based on reciprocal prosodic behaviour in an audio conversation
WO2024182809A1 (en) * 2023-03-02 2024-09-06 Cyborg Inc. Semantic search and retrieval over encrypted vector space
US20240347065A1 (en) * 2023-04-13 2024-10-17 Lg Electronics Inc. Artificial intelligence device for robust multimodal encoder for person representations and control method thereof
US20240428799A1 (en) * 2023-06-20 2024-12-26 Verizon Patent And Licensing Inc. System and method for determining multi-party communication insights
US12688856B2 (en) * 2023-07-17 2026-07-21 Nvidia Corporation Processing of audio data in multi-speaker multi-channel environments
US20250078509A1 (en) * 2023-08-28 2025-03-06 Hewlett-Packard Development Company, L.P. Generation of theme blocks for video
CN120220729A (zh) * 2025-05-28 2025-06-27 沪渝人工智能研究院 一种音频说话人识别方法、系统、存储介质及电子设备
CN121393427B (zh) * 2025-12-23 2026-03-20 江西科晨洪兴信息技术有限公司 一种多说话人的对话分析方法

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20160217792A1 (en) * 2015-01-26 2016-07-28 Verint Systems Ltd. Word-level blind diarization of recorded calls with arbitrary number of speakers
JP2018502319A (ja) * 2015-07-07 2018-01-25 三菱電機株式会社 信号の1つ又は複数の成分を区別する方法
US20200043471A1 (en) * 2017-11-24 2020-02-06 Tencent Technology (Shenzhen) Company Limited Voice data processing method, voice interaction device, and storage medium
US20200349230A1 (en) * 2019-04-30 2020-11-05 Microsoft Technology Licensing, Llc Customized output to optimize for user preference in a distributed system
WO2021002838A1 (en) * 2019-07-01 2021-01-07 Google Llc Adaptive diarization model and user interface

Family Cites Families (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10134401B2 (en) * 2012-11-21 2018-11-20 Verint Systems Ltd. Diarization using linguistic labeling
US10706873B2 (en) * 2015-09-18 2020-07-07 Sri International Real-time speaker state analytics platform
US10497382B2 (en) * 2016-12-16 2019-12-03 Google Llc Associating faces with voices for speaker diarization within videos
US10637898B2 (en) * 2017-05-24 2020-04-28 AffectLayer, Inc. Automatic speaker identification in calls
JP7442494B2 (ja) * 2018-07-25 2024-03-04 ドルビー ラボラトリーズ ライセンシング コーポレイション 光学式捕捉によるパーソナライズされたhrtf
US11152013B2 (en) * 2018-08-02 2021-10-19 Arizona Board Of Regents On Behalf Of Arizona State University Systems and methods for a triplet network with attention for speaker diartzation
EP4009321B1 (en) * 2018-09-25 2024-05-01 Google LLC Speaker diarization using speaker embedding(s) and trained generative model
US11521595B2 (en) * 2020-05-01 2022-12-06 Google Llc End-to-end multi-talker overlapping speech recognition
CN114155840B (zh) * 2020-09-08 2025-08-15 中国电信股份有限公司 语音发起方的区分方法和装置
CN112331182B (zh) * 2020-10-26 2024-07-09 平安科技(深圳)有限公司 语音数据生成方法、装置、计算机设备及存储介质
CN112562693B (zh) * 2021-02-24 2021-05-28 北京远鉴信息技术有限公司 一种基于聚类的说话人确定方法、确定装置及电子设备
US11715487B2 (en) * 2021-03-31 2023-08-01 Accenture Global Solutions Limited Utilizing machine learning models to provide cognitive speaker fractionalization with empathy recognition

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20160217792A1 (en) * 2015-01-26 2016-07-28 Verint Systems Ltd. Word-level blind diarization of recorded calls with arbitrary number of speakers
JP2018502319A (ja) * 2015-07-07 2018-01-25 三菱電機株式会社 信号の1つ又は複数の成分を区別する方法
US20200043471A1 (en) * 2017-11-24 2020-02-06 Tencent Technology (Shenzhen) Company Limited Voice data processing method, voice interaction device, and storage medium
US20200349230A1 (en) * 2019-04-30 2020-11-05 Microsoft Technology Licensing, Llc Customized output to optimize for user preference in a distributed system
WO2021002838A1 (en) * 2019-07-01 2021-01-07 Google Llc Adaptive diarization model and user interface

Also Published As

Publication number Publication date
CN117157708A (zh) 2023-12-01
US20240160849A1 (en) 2024-05-16
WO2022232284A1 (en) 2022-11-03
EP4330965A1 (en) 2024-03-06
EP4330965B1 (en) 2026-04-22

Similar Documents

Publication Publication Date Title
EP4330965B1 (en) Speaker diarization supporting eposodical content
CN112053690B (zh) 一种跨模态多特征融合的音视频语音识别方法及系统
EP3791392B1 (en) Joint neural network for speaker recognition
US11776547B2 (en) System and method of video capture and search optimization for creating an acoustic voiceprint
CN110909613B (zh) 视频人物识别方法、装置、存储介质与电子设备
US11636860B2 (en) Word-level blind diarization of recorded calls with arbitrary number of speakers
US9881617B2 (en) Blind diarization of recorded calls with arbitrary number of speakers
KR102371188B1 (ko) 음성 인식 장치 및 방법과 전자 장치
US9368116B2 (en) Speaker separation in diarization
JP2019211749A (ja) 音声の始点及び終点の検出方法、装置、コンピュータ設備及びプログラム
US12087307B2 (en) Method and apparatus for performing speaker diarization on mixed-bandwidth speech signals
CN111933187B (zh) 情感识别模型的训练方法、装置、计算机设备和存储介质
CN112700766A (zh) 语音识别模型的训练方法及装置、语音识别方法及装置
CN117223052A (zh) 基于神经网络的关键词检出方法
Terraf et al. TOSD-Net: A CNN-transformer architecture for robust frame-level overlapping speech detection in diverse acoustic conditions
US11398239B1 (en) ASR-enhanced speech compression
Yoshida et al. Audio-visual voice activity detection based on an utterance state transition model
US12573378B2 (en) Speech tendency classification
KR101092489B1 (ko) 음성 인식 시스템 및 방법
Srikanth et al. Word Recognition Through Mapping of Lip Movements from Speech Utterance Using Audiovisual Fusion and MLP
Nguyen et al. Speaker diarization: An emerging research
Ghadwal Pipeline for Automated Speaker-Attributed Video Transcription
EP4211681A1 (en) Asr-enhanced speech compression
Chapaneri et al. Emotion recognition from speech using Teager based DSCC features

Legal Events

Date Code Title Description
A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20250425

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20250610

A977 Report on retrieval

Free format text: JAPANESE INTERMEDIATE CODE: A971007

Effective date: 20251128

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20251209

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20260303

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20260519