JP2017509181A5 - - Google Patents
Download PDFInfo
- Publication number
- JP2017509181A5 JP2017509181A5 JP2016543219A JP2016543219A JP2017509181A5 JP 2017509181 A5 JP2017509181 A5 JP 2017509181A5 JP 2016543219 A JP2016543219 A JP 2016543219A JP 2016543219 A JP2016543219 A JP 2016543219A JP 2017509181 A5 JP2017509181 A5 JP 2017509181A5
- Authority
- JP
- Japan
- Prior art keywords
- hand
- audio
- gesture
- acoustic space
- audio stream
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 claims description 20
- 230000003993 interaction Effects 0.000 claims description 2
- 238000012986 modification Methods 0.000 claims description 2
- 230000004048 modification Effects 0.000 claims description 2
Applications Claiming Priority (5)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US201461923571P | 2014-01-03 | 2014-01-03 | |
| US201461923560P | 2014-01-03 | 2014-01-03 | |
| US61/923,560 | 2014-01-03 | ||
| US61/923,571 | 2014-01-03 | ||
| PCT/US2014/073089 WO2015103439A1 (en) | 2014-01-03 | 2014-12-31 | Gesture interactive wearable spatial audio system |
Publications (3)
| Publication Number | Publication Date |
|---|---|
| JP2017509181A JP2017509181A (ja) | 2017-03-30 |
| JP2017509181A5 true JP2017509181A5 (enExample) | 2018-02-15 |
| JP6553052B2 JP6553052B2 (ja) | 2019-07-31 |
Family
ID=52273019
Family Applications (2)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| JP2016543219A Active JP6553052B2 (ja) | 2014-01-03 | 2014-12-31 | ジェスチャ相互作用式の装着可能な空間オーディオシステム |
| JP2015000237A Active JP6494286B2 (ja) | 2014-01-03 | 2015-01-05 | 車載ジェスチャ相互作用空間オーディオシステム |
Family Applications After (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| JP2015000237A Active JP6494286B2 (ja) | 2014-01-03 | 2015-01-05 | 車載ジェスチャ相互作用空間オーディオシステム |
Country Status (5)
| Country | Link |
|---|---|
| US (2) | US10126823B2 (enExample) |
| EP (2) | EP3090321A4 (enExample) |
| JP (2) | JP6553052B2 (enExample) |
| CN (2) | CN105874408B (enExample) |
| WO (1) | WO2015103439A1 (enExample) |
Families Citing this family (68)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US10168873B1 (en) | 2013-10-29 | 2019-01-01 | Leap Motion, Inc. | Virtual interactions for machine control |
| US9996797B1 (en) | 2013-10-31 | 2018-06-12 | Leap Motion, Inc. | Interactions with virtual objects for machine control |
| US9696795B2 (en) | 2015-02-13 | 2017-07-04 | Leap Motion, Inc. | Systems and methods of creating a realistic grab experience in virtual reality/augmented reality environments |
| US10429923B1 (en) | 2015-02-13 | 2019-10-01 | Ultrahaptics IP Two Limited | Interaction engine for creating a realistic experience in virtual reality/augmented reality environments |
| EP3115926A1 (en) * | 2015-07-08 | 2017-01-11 | Nokia Technologies Oy | Method for control using recognition of two-hand gestures |
| AU2016101424A4 (en) * | 2015-09-08 | 2016-09-15 | Apple Inc. | Device, method, and graphical user interface for providing audiovisual feedback |
| US9990113B2 (en) | 2015-09-08 | 2018-06-05 | Apple Inc. | Devices, methods, and graphical user interfaces for moving a current focus using a touch-sensitive remote control |
| CN115525148A (zh) * | 2015-09-16 | 2022-12-27 | 奇跃公司 | 音频文件的头部姿势混合 |
| CN105353868B (zh) * | 2015-09-24 | 2019-05-31 | 联想(北京)有限公司 | 一种信息处理方法及电子设备 |
| US10182325B2 (en) * | 2015-11-23 | 2019-01-15 | Anthony Peter Dobaj | Movement control system |
| CN108886599B (zh) * | 2015-12-11 | 2021-04-27 | 索尼公司 | 信息处理装置、信息处理方法和程序 |
| US9749766B2 (en) * | 2015-12-27 | 2017-08-29 | Philip Scott Lyren | Switching binaural sound |
| US10140507B2 (en) * | 2015-12-29 | 2018-11-27 | Samsung Electronics Co., Ltd. | Apparatus and method for recognizing hand gestures in a virtual reality headset |
| CN107179826B (zh) | 2016-03-11 | 2021-08-31 | 松下知识产权经营株式会社 | 姿势输入系统和姿势输入方法 |
| CN107199888A (zh) | 2016-03-18 | 2017-09-26 | 松下知识产权经营株式会社 | 姿势输入系统和姿势输入方法 |
| WO2017173776A1 (zh) * | 2016-04-05 | 2017-10-12 | 向裴 | 三维环境中的音频编辑方法与系统 |
| US9584653B1 (en) * | 2016-04-10 | 2017-02-28 | Philip Scott Lyren | Smartphone with user interface to externally localize telephone calls |
| CN109153332B (zh) * | 2016-05-20 | 2022-07-08 | 福特全球技术公司 | 车辆用户接口的手语输入 |
| EP3287868B1 (en) * | 2016-08-26 | 2020-10-14 | Nokia Technologies Oy | Content discovery |
| DE102016216543A1 (de) * | 2016-09-01 | 2018-03-01 | Audi Ag | Bedieneinrichtung für ein Komfortsystem eines Kraftfahrzeugs, Komfortsystem mit einer Bedieneinrichtung und Kraftfahrzeug mit einem Komfortsystem |
| EP3293987B1 (en) | 2016-09-13 | 2020-10-21 | Nokia Technologies Oy | Audio processing |
| DE102016119846A1 (de) * | 2016-10-18 | 2018-04-19 | Preh Gmbh | Mensch-Maschine-Schnittstelle aufweisend ein Lenkrad und einen daran befestigten Fingerabdrucksensor |
| EP3312718A1 (en) * | 2016-10-20 | 2018-04-25 | Nokia Technologies OY | Changing spatial audio fields |
| CN107979807A (zh) * | 2016-10-25 | 2018-05-01 | 北京酷我科技有限公司 | 一种模拟环绕立体声的方法及系统 |
| KR101847295B1 (ko) * | 2016-10-31 | 2018-05-28 | 재단법인 다차원 스마트 아이티 융합시스템 연구단 | 초음파 신호의 송수신을 이용하는 사용자 인터페이스 장치 |
| EP3319343A1 (en) * | 2016-11-08 | 2018-05-09 | Harman Becker Automotive Systems GmbH | Vehicle sound processing system |
| CN106774826A (zh) * | 2016-11-15 | 2017-05-31 | 捷开通讯(深圳)有限公司 | 一种vr音效交互系统及其方法 |
| EP3328092B1 (en) | 2016-11-23 | 2022-12-07 | Nokia Technologies Oy | Spatial rendering of a message |
| KR102766959B1 (ko) * | 2017-01-17 | 2025-02-14 | 삼성전자주식회사 | 전자 장치 및 전자 장치의 제어 방법 |
| AU2018244316B2 (en) * | 2017-03-28 | 2022-09-29 | Magic Leap, Inc. | Augmented reality system with spatialized audio tied to user manipulated virtual object |
| CN107102731A (zh) * | 2017-03-31 | 2017-08-29 | 斑马信息科技有限公司 | 用于车辆的手势控制方法及其系统 |
| GB2562036A (en) * | 2017-04-24 | 2018-11-07 | Nokia Technologies Oy | Spatial audio processing |
| US10146501B1 (en) | 2017-06-01 | 2018-12-04 | Qualcomm Incorporated | Sound control by various hand gestures |
| EP3422743B1 (en) * | 2017-06-26 | 2021-02-24 | Nokia Technologies Oy | An apparatus and associated methods for audio presented as spatial audio |
| CN107241643A (zh) * | 2017-08-03 | 2017-10-10 | 沈阳建筑大学 | 一种多媒体音量调节方法及系统 |
| US10614831B2 (en) * | 2017-10-12 | 2020-04-07 | Qualcomm Incorporated | Audio activity tracking and summaries |
| US10306395B1 (en) * | 2018-02-05 | 2019-05-28 | Philip Scott Lyren | Emoji that indicates a location of binaural sound |
| US10063990B1 (en) | 2018-02-18 | 2018-08-28 | Philip Scott Lyren | Altering emoji to indicate sound will externally localize as binaural sound |
| NZ757418A (en) | 2018-03-07 | 2020-06-26 | Magic Leap Inc | Visual tracking of peripheral devices |
| US11009954B2 (en) * | 2018-06-02 | 2021-05-18 | Harman International Industries, Incorporated | Haptics device for producing directional sound and haptic sensations |
| EP3588926B1 (en) | 2018-06-26 | 2021-07-21 | Nokia Technologies Oy | Apparatuses and associated methods for spatial presentation of audio |
| CN109032345B (zh) * | 2018-07-04 | 2022-11-29 | 百度在线网络技术(北京)有限公司 | 设备控制方法、装置、设备、服务端和存储介质 |
| US10154364B1 (en) | 2018-09-09 | 2018-12-11 | Philip Scott Lyren | Moving an emoji to move a location of binaural sound |
| CN110928399B (zh) * | 2018-09-19 | 2023-05-05 | 阿里巴巴集团控股有限公司 | 控制系统、方法及电子设备 |
| CN109308179A (zh) * | 2018-09-25 | 2019-02-05 | Oppo广东移动通信有限公司 | 3d音效处理方法及相关产品 |
| US10499179B1 (en) | 2019-01-01 | 2019-12-03 | Philip Scott Lyren | Displaying emojis for binaural sound |
| DE102019202687A1 (de) * | 2019-02-28 | 2020-09-03 | Audi Ag | Kraftfahrzeug mit einer Lautsprechervorrichtung, und Verfahren zum Betreiben einer Lautsprechervorrichtung |
| US10846898B2 (en) * | 2019-03-28 | 2020-11-24 | Nanning Fugui Precision Industrial Co., Ltd. | Method and device for setting a multi-user virtual reality chat environment |
| US11039265B1 (en) * | 2019-12-13 | 2021-06-15 | Bose Corporation | Spatialized audio assignment |
| GB2593136B (en) * | 2019-12-18 | 2022-05-04 | Nokia Technologies Oy | Rendering audio |
| CN113568596B (zh) * | 2020-04-29 | 2025-09-12 | 阿里巴巴集团控股有限公司 | 电子设备 |
| CN111625094B (zh) * | 2020-05-25 | 2023-07-14 | 阿波罗智联(北京)科技有限公司 | 智能后视镜的交互方法、装置、电子设备和存储介质 |
| CN112771480B (zh) * | 2020-06-28 | 2022-04-12 | 华为技术有限公司 | 交互方法及电子设备 |
| US11750997B2 (en) * | 2020-07-07 | 2023-09-05 | Comhear Inc. | System and method for providing a spatialized soundfield |
| WO2022019085A1 (ja) * | 2020-07-20 | 2022-01-27 | ソニーグループ株式会社 | 情報処理装置、及び情報処理方法 |
| CN112083379B (zh) * | 2020-09-09 | 2023-10-20 | 极米科技股份有限公司 | 基于声源定位的音频播放方法、装置、投影设备及介质 |
| JP7474175B2 (ja) * | 2020-10-07 | 2024-04-24 | 株式会社デンソーテン | 音像描画装置及び音像描画方法 |
| USD997107S1 (en) | 2020-12-04 | 2023-08-29 | Zoox, Inc. | Door interface system having an animated visual indicator |
| EP4030783A1 (en) | 2021-01-19 | 2022-07-20 | Nokia Technologies Oy | Indication of responsibility for audio playback |
| EP4057645A1 (en) * | 2021-03-08 | 2022-09-14 | Nokia Technologies Oy | Apparatus, methods and computer programs for providing an audio user interface |
| JP7605034B2 (ja) * | 2021-06-10 | 2024-12-24 | トヨタ紡織株式会社 | 制御装置、制御方法および制御プログラム |
| DE102021116641A1 (de) | 2021-06-28 | 2022-12-29 | Dr. Ing. H.C. F. Porsche Aktiengesellschaft | Verfahren, System und Computerprogramm zur interaktiven Auswahl und Wiedergabe von in Echtzeit erzeugten Audio- und/oder Videosequenzen in einem Kraftfahrzeug |
| CN115834757B (zh) * | 2021-09-17 | 2024-11-05 | 北京小米移动软件有限公司 | 数据传输方法、电子设备、通信系统及可读存储介质 |
| EP4207814B1 (en) * | 2021-12-28 | 2024-07-03 | GN Audio A/S | Hearing device |
| US20240217539A1 (en) * | 2023-01-03 | 2024-07-04 | Toyota Research Institute, Inc. | Multisensory gestural-audio interface to promote situational awareness for improved autonomous vehicle control |
| DE102023002174B3 (de) * | 2023-05-30 | 2024-05-08 | Mercedes-Benz Group AG | Verfahren zum Kalibrieren eines fahrzeugintegrierten binauralen 3D-Audiosystems und Fahrzeug |
| WO2025149149A1 (en) * | 2024-01-08 | 2025-07-17 | MARELLI EUROPE S.p.A | Signaling apparatus for signaling information content to a user in a vehicle and corresponding signaling method |
| KR20250141507A (ko) * | 2024-03-20 | 2025-09-29 | 삼성전자주식회사 | 무선 환경 내에서 전력소모 감소를 위한 전자 장치, 방법, 및 컴퓨터 판독 가능 저장 매체 |
Family Cites Families (58)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPH05241573A (ja) | 1992-02-28 | 1993-09-21 | Kan Oteru | 音響空間制御システム |
| GB2284968A (en) * | 1993-12-18 | 1995-06-21 | Ibm | Audio conferencing system |
| JP3834848B2 (ja) | 1995-09-20 | 2006-10-18 | 株式会社日立製作所 | 音情報提供装置、及び音情報選択方法 |
| EP0905644A3 (en) | 1997-09-26 | 2004-02-25 | Matsushita Electric Industrial Co., Ltd. | Hand gesture recognizing device |
| US6230130B1 (en) * | 1998-05-18 | 2001-05-08 | U.S. Philips Corporation | Scalable mixing for speech streaming |
| US6647119B1 (en) | 1998-06-29 | 2003-11-11 | Microsoft Corporation | Spacialization of audio with visual cues |
| JP2986455B1 (ja) | 1998-07-24 | 1999-12-06 | 株式会社エイ・ティ・アール知能映像通信研究所 | 手振り認識装置 |
| FI20010958A0 (fi) * | 2001-05-08 | 2001-05-08 | Nokia Corp | Menetelmä ja järjestely laajennetun käyttöliittymän muodostamiseksi |
| KR100542129B1 (ko) | 2002-10-28 | 2006-01-11 | 한국전자통신연구원 | 객체기반 3차원 오디오 시스템 및 그 제어 방법 |
| US7774075B2 (en) * | 2002-11-06 | 2010-08-10 | Lin Julius J Y | Audio-visual three-dimensional input/output |
| JP4364024B2 (ja) | 2004-03-18 | 2009-11-11 | 株式会社日立製作所 | 携帯端末 |
| US20050222844A1 (en) * | 2004-04-01 | 2005-10-06 | Hideya Kawahara | Method and apparatus for generating spatialized audio from non-three-dimensionally aware applications |
| JP4838499B2 (ja) * | 2004-05-21 | 2011-12-14 | オリンパス株式会社 | ユーザ支援装置 |
| WO2006137400A1 (ja) | 2005-06-21 | 2006-12-28 | Japan Science And Technology Agency | ミキシング装置及び方法並びにプログラム |
| US7853649B2 (en) * | 2006-09-21 | 2010-12-14 | Apple Inc. | Audio processing for improved user experience |
| JP2008123431A (ja) | 2006-11-15 | 2008-05-29 | Canon Inc | 接触提示装置及び方法 |
| WO2008132724A1 (en) | 2007-04-26 | 2008-11-06 | Mantisvision Ltd. | A method and apparatus for three dimensional interaction with autosteroscopic displays |
| US8655004B2 (en) | 2007-10-16 | 2014-02-18 | Apple Inc. | Sports monitoring system for headphones, earbuds and/or headsets |
| JP4518142B2 (ja) | 2007-12-25 | 2010-08-04 | ソニー株式会社 | 音場補正装置、音場補正方法 |
| CN102112945B (zh) | 2008-06-18 | 2016-08-10 | 奥布隆工业有限公司 | 用于交通工具接口的基于姿态的控制系统 |
| US9445193B2 (en) | 2008-07-31 | 2016-09-13 | Nokia Technologies Oy | Electronic device directional audio capture |
| US8624962B2 (en) * | 2009-02-02 | 2014-01-07 | Ydreams—Informatica, S.A. Ydreams | Systems and methods for simulating three-dimensional virtual interactions from two-dimensional camera images |
| JP2010258623A (ja) | 2009-04-22 | 2010-11-11 | Yamaha Corp | 操作検出装置 |
| US8144633B2 (en) * | 2009-09-22 | 2012-03-27 | Avaya Inc. | Method and system for controlling audio in a collaboration environment |
| US8190438B1 (en) * | 2009-10-14 | 2012-05-29 | Google Inc. | Targeted audio in multi-dimensional space |
| CN201845422U (zh) | 2010-06-18 | 2011-05-25 | 精伦电子股份有限公司 | 一种无线遥控装置 |
| US20120075167A1 (en) * | 2010-09-29 | 2012-03-29 | Eastman Kodak Company | Head-mounted display with wireless controller |
| US20130208926A1 (en) | 2010-10-13 | 2013-08-15 | Microsoft Corporation | Surround sound simulation with virtual skeleton modeling |
| US8824709B2 (en) | 2010-10-14 | 2014-09-02 | National Semiconductor Corporation | Generation of 3D sound with adjustable source positioning |
| US8767970B2 (en) * | 2011-02-16 | 2014-07-01 | Apple Inc. | Audio panning with multi-channel surround sound decoding |
| US9329469B2 (en) * | 2011-02-17 | 2016-05-03 | Microsoft Technology Licensing, Llc | Providing an interactive experience using a 3D depth camera and a 3D projector |
| CN103053181A (zh) | 2011-03-08 | 2013-04-17 | 松下电器产业株式会社 | 语音控制装置及语音控制方法 |
| US8559651B2 (en) | 2011-03-11 | 2013-10-15 | Blackberry Limited | Synthetic stereo on a mono headset with motion sensing |
| US9620131B2 (en) | 2011-04-08 | 2017-04-11 | Evertz Microsystems Ltd. | Systems and methods for adjusting audio levels in a plurality of audio signals |
| WO2012140525A1 (en) | 2011-04-12 | 2012-10-18 | International Business Machines Corporation | Translating user interface sounds into 3d audio space |
| WO2012164153A1 (en) | 2011-05-23 | 2012-12-06 | Nokia Corporation | Spatial audio processing apparatus |
| WO2013009413A1 (en) | 2011-06-06 | 2013-01-17 | Intellitact Llc | Relative touch user interface enhancements |
| JP5757166B2 (ja) * | 2011-06-09 | 2015-07-29 | ソニー株式会社 | 音制御装置、プログラム及び制御方法 |
| DE112012004778T5 (de) * | 2011-11-16 | 2014-08-07 | Flextronics Ap, Llc | Universeller Bus im Auto |
| CN102520791A (zh) | 2011-11-28 | 2012-06-27 | 北京盈胜泰科技术有限公司 | 一种无线手势识别装置 |
| US9563278B2 (en) | 2011-12-19 | 2017-02-07 | Qualcomm Incorporated | Gesture controlled audio user interface |
| US8749485B2 (en) | 2011-12-20 | 2014-06-10 | Microsoft Corporation | User control gesture detection |
| US9632744B2 (en) | 2011-12-22 | 2017-04-25 | Nokia Technologies Oy | Audio-visual interface for apparatus |
| WO2014172369A2 (en) | 2013-04-15 | 2014-10-23 | Flextronics Ap, Llc | Intelligent vehicle for assisting vehicle occupants and incorporating vehicle crate for blade processors |
| JP5825176B2 (ja) | 2012-03-29 | 2015-12-02 | 富士通株式会社 | 携帯端末、音源位置制御方法および音源位置制御プログラム |
| US10448161B2 (en) | 2012-04-02 | 2019-10-15 | Qualcomm Incorporated | Systems, methods, apparatus, and computer-readable media for gestural manipulation of a sound field |
| US20130279706A1 (en) | 2012-04-23 | 2013-10-24 | Stefan J. Marti | Controlling individual audio output devices based on detected inputs |
| US20140002357A1 (en) * | 2012-06-28 | 2014-01-02 | Kopin Corporation | Enabling and Disabling Features of a Headset Computer Based on Real-Time Image Analysis |
| US9646522B2 (en) * | 2012-06-29 | 2017-05-09 | Intel Corporation | Enhanced information delivery using a transparent display |
| KR20140047948A (ko) | 2012-10-15 | 2014-04-23 | 엘지전자 주식회사 | 영상표시장치, 및 그 동작방법 |
| US9632683B2 (en) * | 2012-11-08 | 2017-04-25 | Nokia Technologies Oy | Methods, apparatuses and computer program products for manipulating characteristics of audio objects by using directional gestures |
| US10291983B2 (en) | 2013-03-15 | 2019-05-14 | Elwha Llc | Portable electronic device directed audio system and method |
| CN103164995A (zh) | 2013-04-03 | 2013-06-19 | 湖南第一师范学院 | 儿童体感交互式学习系统及方法 |
| US9529513B2 (en) | 2013-08-05 | 2016-12-27 | Microsoft Technology Licensing, Llc | Two-hand interaction with natural user interface |
| US8943569B1 (en) | 2013-10-01 | 2015-01-27 | Myth Innovations, Inc. | Wireless server access control system and method |
| US9829979B2 (en) * | 2014-04-28 | 2017-11-28 | Ford Global Technologies, Llc | Automotive touchscreen controls with simulated texture for haptic feedback |
| US10073607B2 (en) * | 2014-07-03 | 2018-09-11 | Qualcomm Incorporated | Single-channel or multi-channel audio control interface |
| US9544679B2 (en) * | 2014-12-08 | 2017-01-10 | Harman International Industries, Inc. | Adjusting speakers using facial recognition |
-
2014
- 2014-12-31 US US14/587,602 patent/US10126823B2/en active Active
- 2014-12-31 CN CN201480072176.6A patent/CN105874408B/zh active Active
- 2014-12-31 US US15/107,774 patent/US10585486B2/en active Active
- 2014-12-31 WO PCT/US2014/073089 patent/WO2015103439A1/en not_active Ceased
- 2014-12-31 JP JP2016543219A patent/JP6553052B2/ja active Active
- 2014-12-31 EP EP14876011.9A patent/EP3090321A4/en not_active Ceased
-
2015
- 2015-01-02 EP EP15150026.1A patent/EP2891955B1/en active Active
- 2015-01-04 CN CN201510002271.5A patent/CN104765444B/zh active Active
- 2015-01-05 JP JP2015000237A patent/JP6494286B2/ja active Active