RU2708441C2 - Устройство, способ и программа аудиообработки - Google Patents
Устройство, способ и программа аудиообработки Download PDFInfo
- Publication number
- RU2708441C2 RU2708441C2 RU2017143920A RU2017143920A RU2708441C2 RU 2708441 C2 RU2708441 C2 RU 2708441C2 RU 2017143920 A RU2017143920 A RU 2017143920A RU 2017143920 A RU2017143920 A RU 2017143920A RU 2708441 C2 RU2708441 C2 RU 2708441C2
- Authority
- RU
- Russia
- Prior art keywords
- spread
- vector
- gain
- sound
- audio
- Prior art date
Links
- 238000012545 processing Methods 0.000 title claims abstract description 143
- 238000000034 method Methods 0.000 title description 505
- 239000013598 vector Substances 0.000 claims abstract description 640
- 230000005236 sound signal Effects 0.000 claims abstract description 89
- 238000004364 calculation method Methods 0.000 claims description 115
- 238000013139 quantization Methods 0.000 claims description 65
- 238000013480 data collection Methods 0.000 claims description 10
- 238000003672 processing method Methods 0.000 claims description 3
- 230000000694 effects Effects 0.000 abstract description 14
- 239000000126 substance Substances 0.000 abstract 1
- 230000008569 process Effects 0.000 description 440
- 238000009877 rendering Methods 0.000 description 74
- 238000005516 engineering process Methods 0.000 description 34
- 230000005855 radiation Effects 0.000 description 31
- 238000006243 chemical reaction Methods 0.000 description 19
- 230000006866 deterioration Effects 0.000 description 12
- 230000004044 response Effects 0.000 description 11
- 230000008859 change Effects 0.000 description 9
- 230000003321 amplification Effects 0.000 description 8
- 238000003199 nucleic acid amplification method Methods 0.000 description 8
- 238000010606 normalization Methods 0.000 description 7
- 230000004807 localization Effects 0.000 description 6
- 230000007423 decrease Effects 0.000 description 5
- 238000012937 correction Methods 0.000 description 4
- 230000006870 function Effects 0.000 description 4
- 238000004091 panning Methods 0.000 description 4
- 230000015556 catabolic process Effects 0.000 description 3
- 238000004891 communication Methods 0.000 description 3
- 238000006731 degradation reaction Methods 0.000 description 3
- 230000005540 biological transmission Effects 0.000 description 2
- NRNCYVBFPDDJNE-UHFFFAOYSA-N pemoline Chemical compound O1C(N)=NC(=O)C1C1=CC=CC=C1 NRNCYVBFPDDJNE-UHFFFAOYSA-N 0.000 description 2
- 230000008447 perception Effects 0.000 description 2
- 230000009467 reduction Effects 0.000 description 2
- 101100355601 Saccharomyces cerevisiae (strain ATCC 204508 / S288c) RAD53 gene Proteins 0.000 description 1
- 230000015572 biosynthetic process Effects 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 239000011159 matrix material Substances 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 230000013707 sensory perception of sound Effects 0.000 description 1
- 101150087667 spk1 gene Proteins 0.000 description 1
- 230000007480 spreading Effects 0.000 description 1
- 230000009466 transformation Effects 0.000 description 1
- 210000001260 vocal cord Anatomy 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L19/00—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
- G10L19/008—Multichannel audio signal coding or decoding using interchannel correlation to reduce redundancy, e.g. joint-stereo, intensity-coding or matrixing
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04S—STEREOPHONIC SYSTEMS
- H04S3/00—Systems employing more than two channels, e.g. quadraphonic
- H04S3/008—Systems employing more than two channels, e.g. quadraphonic in which the audio signals are in digital form, i.e. employing more than two discrete digital channels
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04S—STEREOPHONIC SYSTEMS
- H04S5/00—Pseudo-stereo systems, e.g. in which additional channel signals are derived from monophonic signals by means of phase shifting, time delay or reverberation
- H04S5/02—Pseudo-stereo systems, e.g. in which additional channel signals are derived from monophonic signals by means of phase shifting, time delay or reverberation of the pseudo four-channel type, e.g. in which rear channel signals are derived from two-channel stereo signals
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04S—STEREOPHONIC SYSTEMS
- H04S7/00—Indicating arrangements; Control arrangements, e.g. balance control
- H04S7/30—Control circuits for electronic adaptation of the sound field
- H04S7/302—Electronic adaptation of stereophonic sound system to listener position or orientation
- H04S7/303—Tracking of listener position or orientation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04S—STEREOPHONIC SYSTEMS
- H04S2400/00—Details of stereophonic systems covered by H04S but not provided for in its groups
- H04S2400/01—Multi-channel, i.e. more than two input channels, sound reproduction with two speakers wherein the multi-channel information is substantially preserved
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04S—STEREOPHONIC SYSTEMS
- H04S2400/00—Details of stereophonic systems covered by H04S but not provided for in its groups
- H04S2400/11—Positioning of individual sound objects, e.g. moving airplane, within a sound field
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04S—STEREOPHONIC SYSTEMS
- H04S2400/00—Details of stereophonic systems covered by H04S but not provided for in its groups
- H04S2400/13—Aspects of volume control, not necessarily automatic, in stereophonic sound systems
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04S—STEREOPHONIC SYSTEMS
- H04S2400/00—Details of stereophonic systems covered by H04S but not provided for in its groups
- H04S2400/15—Aspects of sound capture and related signal processing for recording or reproduction
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Acoustics & Sound (AREA)
- Signal Processing (AREA)
- Multimedia (AREA)
- Mathematical Physics (AREA)
- Computational Linguistics (AREA)
- Health & Medical Sciences (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Human Computer Interaction (AREA)
- Stereophonic System (AREA)
- Circuit For Audible Band Transducer (AREA)
Applications Claiming Priority (5)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| JP2015-126650 | 2015-06-24 | ||
| JP2015126650 | 2015-06-24 | ||
| JP2015148683 | 2015-07-28 | ||
| JP2015-148683 | 2015-07-28 | ||
| PCT/JP2016/067195 WO2016208406A1 (ja) | 2015-06-24 | 2016-06-09 | 音声処理装置および方法、並びにプログラム |
Related Child Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| RU2019138260A Division RU2019138260A (ru) | 2015-06-24 | 2016-06-09 | Устройство, способ и программа аудиообработки |
Publications (3)
| Publication Number | Publication Date |
|---|---|
| RU2017143920A RU2017143920A (ru) | 2019-06-17 |
| RU2017143920A3 RU2017143920A3 (enExample) | 2019-09-30 |
| RU2708441C2 true RU2708441C2 (ru) | 2019-12-06 |
Family
ID=57585608
Family Applications (2)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| RU2017143920A RU2708441C2 (ru) | 2015-06-24 | 2016-06-09 | Устройство, способ и программа аудиообработки |
| RU2019138260A RU2019138260A (ru) | 2015-06-24 | 2016-06-09 | Устройство, способ и программа аудиообработки |
Family Applications After (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| RU2019138260A RU2019138260A (ru) | 2015-06-24 | 2016-06-09 | Устройство, способ и программа аудиообработки |
Country Status (11)
| Country | Link |
|---|---|
| US (6) | US10567903B2 (enExample) |
| EP (4) | EP4645909A3 (enExample) |
| JP (5) | JP6962192B2 (enExample) |
| KR (6) | KR102770728B1 (enExample) |
| CN (3) | CN112562697B (enExample) |
| AU (4) | AU2016283182B2 (enExample) |
| BR (3) | BR122022019901B1 (enExample) |
| ES (2) | ES3050216T3 (enExample) |
| RU (2) | RU2708441C2 (enExample) |
| SG (1) | SG11201710080XA (enExample) |
| WO (1) | WO2016208406A1 (enExample) |
Families Citing this family (18)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| ES3050216T3 (en) | 2015-06-24 | 2025-12-19 | Sony Group Corp | Audio processing apparatus and method, and program |
| US9949052B2 (en) * | 2016-03-22 | 2018-04-17 | Dolby Laboratories Licensing Corporation | Adaptive panner of audio objects |
| US10255032B2 (en) * | 2016-12-13 | 2019-04-09 | EVA Automation, Inc. | Wireless coordination of audio sources |
| JP6868093B2 (ja) * | 2017-03-24 | 2021-05-12 | シャープ株式会社 | 音声信号処理装置及び音声信号処理システム |
| RU2763785C2 (ru) * | 2017-04-25 | 2022-01-11 | Сони Корпорейшн | Способ и устройство обработки сигнала |
| KR20240042125A (ko) * | 2017-04-26 | 2024-04-01 | 소니그룹주식회사 | 신호 처리 장치 및 방법, 및 프로그램 |
| WO2019187434A1 (ja) * | 2018-03-29 | 2019-10-03 | ソニー株式会社 | 情報処理装置、情報処理方法、及びプログラム |
| CN111886880B (zh) | 2018-04-09 | 2021-11-02 | 杜比国际公司 | 用于mpeg-h 3d音频的三自由度(3dof+)扩展的方法、设备和系统 |
| US11375332B2 (en) | 2018-04-09 | 2022-06-28 | Dolby International Ab | Methods, apparatus and systems for three degrees of freedom (3DoF+) extension of MPEG-H 3D audio |
| WO2019197349A1 (en) * | 2018-04-11 | 2019-10-17 | Dolby International Ab | Methods, apparatus and systems for a pre-rendered signal for audio rendering |
| KR102653185B1 (ko) | 2018-04-12 | 2024-04-02 | 소니그룹주식회사 | 정보 처리 장치 및 방법, 그리고 프로그램이 저장된 컴퓨터 판독 가능한 기록매체 |
| JP7363795B2 (ja) * | 2018-09-28 | 2023-10-18 | ソニーグループ株式会社 | 情報処理装置および方法、並びにプログラム |
| KR102649597B1 (ko) * | 2019-01-02 | 2024-03-20 | 한국전자통신연구원 | 무인 비행체를 이용한 신호원의 위치정보 확인 방법 및 장치 |
| US11968518B2 (en) * | 2019-03-29 | 2024-04-23 | Sony Group Corporation | Apparatus and method for generating spatial audio |
| KR102127179B1 (ko) * | 2019-06-05 | 2020-06-26 | 서울과학기술대학교 산학협력단 | 플렉서블 렌더링을 이용한 가상 현실 기반 음향 시뮬레이션 시스템 |
| CN115943461A (zh) * | 2020-07-09 | 2023-04-07 | 索尼集团公司 | 信号处理装置、方法及程序 |
| JP7643113B2 (ja) | 2021-03-19 | 2025-03-11 | ヤマハ株式会社 | 音信号処理方法および音信号処理装置 |
| CN113889125B (zh) * | 2021-12-02 | 2022-03-04 | 腾讯科技（深圳）有限公司 | 音频生成方法、装置、计算机设备和存储介质 |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2007007263A2 (en) * | 2005-07-14 | 2007-01-18 | Koninklijke Philips Electronics N.V. | Audio encoding and decoding |
| RU2454825C2 (ru) * | 2006-09-14 | 2012-06-27 | Конинклейке Филипс Электроникс Н.В. | Манипулирование зоной наилучшего восприятия для многоканального сигнала |
| WO2013064860A1 (en) * | 2011-10-31 | 2013-05-10 | Nokia Corporation | Audio scene rendering by aligning series of time-varying feature data |
| RU2513910C2 (ru) * | 2008-05-13 | 2014-04-20 | Стормингсвисс Гмбх | Работающее в зависимости от угла устройство или способ получения псевдостереофонического аудиосигнала |
| RU2525109C2 (ru) * | 2009-06-05 | 2014-08-10 | Конинклейке Филипс Электроникс Н.В. | Система объемного звука и способ для нее |
Family Cites Families (27)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CA1037877A (en) * | 1971-12-31 | 1978-09-05 | Peter Scheiber | Decoder apparatus for use in a multidirectional sound system |
| US5046097A (en) | 1988-09-02 | 1991-09-03 | Qsound Ltd. | Sound imaging process |
| JP3657120B2 (ja) * | 1998-07-30 | 2005-06-08 | 株式会社アーニス・サウンド・テクノロジーズ | 左，右両耳用のオーディオ信号を音像定位させるための処理方法 |
| ATE341923T1 (de) * | 2002-08-07 | 2006-10-15 | Dolby Lab Licensing Corp | Audiokanalumsetzung |
| JP2006128816A (ja) * | 2004-10-26 | 2006-05-18 | Victor Co Of Japan Ltd | 立体映像・立体音響対応記録プログラム、再生プログラム、記録装置、再生装置及び記録メディア |
| KR100708196B1 (ko) * | 2005-11-30 | 2007-04-17 | 삼성전자주식회사 | 모노 스피커를 이용한 확장된 사운드 재생 장치 및 방법 |
| WO2007083739A1 (ja) * | 2006-01-19 | 2007-07-26 | Nippon Hoso Kyokai | ３次元音響パンニング装置 |
| CN101479785B (zh) * | 2006-09-29 | 2013-08-07 | Lg电子株式会社 | 用于编码和解码基于对象的音频信号的方法和装置 |
| JP5029869B2 (ja) * | 2006-11-09 | 2012-09-19 | ソニー株式会社 | 画像処理装置および画像処理方法、学習装置および学習方法、並びにプログラム |
| US8295494B2 (en) * | 2007-08-13 | 2012-10-23 | Lg Electronics Inc. | Enhancing audio with remixing capability |
| EP2478716B8 (en) * | 2009-11-04 | 2014-01-08 | Fraunhofer Gesellschaft zur Förderung der angewandten Forschung e.V. | Apparatus and method for calculating driving coefficients for loudspeakers of a loudspeaker arrangement for an audio signal associated with a virtual source |
| JP2012119738A (ja) * | 2010-11-29 | 2012-06-21 | Sony Corp | 情報処理装置、情報処理方法およびプログラム |
| JP5699566B2 (ja) * | 2010-11-29 | 2015-04-15 | ソニー株式会社 | 情報処理装置、情報処理方法およびプログラム |
| EP4132011B1 (en) * | 2011-07-01 | 2025-03-26 | Dolby Laboratories Licensing Corporation | Apparatus for rendering audio objects according to imposed speaker zone constraints, corresponding method and computer program product |
| JP2013135310A (ja) * | 2011-12-26 | 2013-07-08 | Sony Corp | 情報処理装置、情報処理方法、プログラム、記録媒体、及び、情報処理システム |
| US9516446B2 (en) * | 2012-07-20 | 2016-12-06 | Qualcomm Incorporated | Scalable downmix design for object-based surround codec with cluster analysis by synthesis |
| JP6102179B2 (ja) * | 2012-08-23 | 2017-03-29 | ソニー株式会社 | 音声処理装置および方法、並びにプログラム |
| WO2014160576A2 (en) * | 2013-03-28 | 2014-10-02 | Dolby Laboratories Licensing Corporation | Rendering audio using speakers organized as a mesh of arbitrary n-gons |
| EP4329338A3 (en) * | 2013-04-26 | 2024-05-22 | Sony Group Corporation | Audio processing device, method, and program |
| TWI615834B (zh) | 2013-05-31 | 2018-02-21 | Sony Corp | 編碼裝置及方法、解碼裝置及方法、以及程式 |
| WO2015002517A1 (ko) | 2013-07-05 | 2015-01-08 | 한국전자통신연구원 | 2차원 및 3차원 공간 상에서의 가상 음상 정위 방법 |
| CN105379311B (zh) | 2013-07-24 | 2018-01-16 | 索尼公司 | 信息处理设备以及信息处理方法 |
| RU2677597C2 (ru) | 2013-10-09 | 2019-01-17 | Сони Корпорейшн | Способ и устройство кодирования, способ и устройство декодирования и программа |
| JP6187131B2 (ja) | 2013-10-17 | 2017-08-30 | ヤマハ株式会社 | 音像定位装置 |
| JP6197115B2 (ja) * | 2013-11-14 | 2017-09-13 | ドルビー ラボラトリーズ ライセンシング コーポレイション | オーディオの対スクリーン・レンダリングおよびそのようなレンダリングのためのオーディオのエンコードおよびデコード |
| FR3024310A1 (fr) * | 2014-07-25 | 2016-01-29 | Commissariat Energie Atomique | Procede de regulation dynamique de debits de consigne dans un reseau sur puce, programme d'ordinateur et dispositif de traitement de donnees correspondants |
| ES3050216T3 (en) * | 2015-06-24 | 2025-12-19 | Sony Group Corp | Audio processing apparatus and method, and program |
-
2016
- 2016-06-09 ES ES24158155T patent/ES3050216T3/es active Active
- 2016-06-09 EP EP25196916.8A patent/EP4645909A3/en active Pending
- 2016-06-09 AU AU2016283182A patent/AU2016283182B2/en active Active
- 2016-06-09 ES ES20155520T patent/ES2980610T3/es active Active
- 2016-06-09 RU RU2017143920A patent/RU2708441C2/ru active
- 2016-06-09 EP EP24158155.2A patent/EP4354905B1/en active Active
- 2016-06-09 CN CN202011538529.0A patent/CN112562697B/zh active Active
- 2016-06-09 RU RU2019138260A patent/RU2019138260A/ru unknown
- 2016-06-09 KR KR1020247003591A patent/KR102770728B1/ko active Active
- 2016-06-09 EP EP16814177.8A patent/EP3319342B1/en active Active
- 2016-06-09 BR BR122022019901-1A patent/BR122022019901B1/pt active IP Right Grant
- 2016-06-09 JP JP2017525183A patent/JP6962192B2/ja active Active
- 2016-06-09 KR KR1020227001727A patent/KR102488354B1/ko active Active
- 2016-06-09 BR BR112017027103-6A patent/BR112017027103B1/pt active IP Right Grant
- 2016-06-09 WO PCT/JP2016/067195 patent/WO2016208406A1/ja not_active Ceased
- 2016-06-09 BR BR122022019910-0A patent/BR122022019910B1/pt active IP Right Grant
- 2016-06-09 CN CN201680034827.1A patent/CN107710790B/zh active Active
- 2016-06-09 KR KR1020187035934A patent/KR102373459B1/ko active Active
- 2016-06-09 CN CN202110611258.5A patent/CN113473353B/zh active Active
- 2016-06-09 KR KR1020257000490A patent/KR20250012717A/ko active Pending
- 2016-06-09 KR KR1020177035890A patent/KR101930671B1/ko active Active
- 2016-06-09 SG SG11201710080XA patent/SG11201710080XA/en unknown
- 2016-06-09 EP EP20155520.8A patent/EP3680898B1/en active Active
- 2016-06-09 KR KR1020237000959A patent/KR102633077B1/ko active Active
- 2016-06-09 US US15/737,026 patent/US10567903B2/en active Active
-
2019
- 2019-04-26 AU AU2019202924A patent/AU2019202924B2/en active Active
-
2020
- 2020-01-03 US US16/734,211 patent/US11140505B2/en active Active
- 2020-11-26 AU AU2020277210A patent/AU2020277210B2/en active Active
-
2021
- 2021-09-14 US US17/474,669 patent/US11540080B2/en active Active
- 2021-10-13 JP JP2021168115A patent/JP7147948B2/ja active Active
-
2022
- 2022-03-04 AU AU2022201515A patent/AU2022201515A1/en not_active Abandoned
- 2022-09-22 JP JP2022151327A patent/JP7400910B2/ja active Active
- 2022-11-23 US US17/993,001 patent/US12096202B2/en active Active
-
2023
- 2023-12-07 JP JP2023207055A patent/JP7626190B2/ja active Active
-
2024
- 2024-05-14 US US18/663,637 patent/US12294850B2/en active Active
-
2025
- 2025-01-22 JP JP2025008873A patent/JP2025061575A/ja active Pending
- 2025-04-09 US US19/174,399 patent/US20250240591A1/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2007007263A2 (en) * | 2005-07-14 | 2007-01-18 | Koninklijke Philips Electronics N.V. | Audio encoding and decoding |
| RU2454825C2 (ru) * | 2006-09-14 | 2012-06-27 | Конинклейке Филипс Электроникс Н.В. | Манипулирование зоной наилучшего восприятия для многоканального сигнала |
| RU2513910C2 (ru) * | 2008-05-13 | 2014-04-20 | Стормингсвисс Гмбх | Работающее в зависимости от угла устройство или способ получения псевдостереофонического аудиосигнала |
| RU2525109C2 (ru) * | 2009-06-05 | 2014-08-10 | Конинклейке Филипс Электроникс Н.В. | Система объемного звука и способ для нее |
| WO2013064860A1 (en) * | 2011-10-31 | 2013-05-10 | Nokia Corporation | Audio scene rendering by aligning series of time-varying feature data |
Also Published As
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| RU2708441C2 (ru) | Устройство, способ и программа аудиообработки |