JP2018527655A - ユーザ・ハプティック空間(HapSpace)に基づくハプティック・フィードバックおよびインタラクティブ性を提供する方法および装置 - Google Patents
ユーザ・ハプティック空間(HapSpace)に基づくハプティック・フィードバックおよびインタラクティブ性を提供する方法および装置 Download PDFInfo
- Publication number
- JP2018527655A JP2018527655A JP2018500919A JP2018500919A JP2018527655A JP 2018527655 A JP2018527655 A JP 2018527655A JP 2018500919 A JP2018500919 A JP 2018500919A JP 2018500919 A JP2018500919 A JP 2018500919A JP 2018527655 A JP2018527655 A JP 2018527655A
- Authority
- JP
- Japan
- Prior art keywords
- haptic
- user
- bitstream
- space
- descriptor
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
- A63F13/25—Output arrangements for video game devices
- A63F13/28—Output arrangements for video game devices responding to control signals received from the game device for affecting ambient conditions, e.g. for vibrating players' seats, activating scent dispensers or affecting temperature or light
- A63F13/285—Generating tactile feedback signals via the game input device, e.g. force feedback
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
- A63F13/25—Output arrangements for video game devices
- A63F13/28—Output arrangements for video game devices responding to control signals received from the game device for affecting ambient conditions, e.g. for vibrating players' seats, activating scent dispensers or affecting temperature or light
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/016—Input arrangements with force or tactile feedback as computer generated output to the user
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Multimedia (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- User Interface Of Digital Computer (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Applications Claiming Priority (3)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| EP15306156.9A EP3118723A1 (en) | 2015-07-13 | 2015-07-13 | Method and apparatus for providing haptic feedback and interactivity based on user haptic space (hapspace) |
| EP15306156.9 | 2015-07-13 | ||
| PCT/EP2016/066157 WO2017009181A1 (en) | 2015-07-13 | 2016-07-07 | Method and apparatus for providing haptic feedback and interactivity based on user haptic space (hapspace) |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| JP2018527655A true JP2018527655A (ja) | 2018-09-20 |
| JP2018527655A5 JP2018527655A5 (enExample) | 2019-08-15 |
Family
ID=53758150
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| JP2018500919A Pending JP2018527655A (ja) | 2015-07-13 | 2016-07-07 | ユーザ・ハプティック空間(HapSpace)に基づくハプティック・フィードバックおよびインタラクティブ性を提供する方法および装置 |
Country Status (10)
| Country | Link |
|---|---|
| US (1) | US11964200B2 (enExample) |
| EP (2) | EP3118723A1 (enExample) |
| JP (1) | JP2018527655A (enExample) |
| KR (1) | KR20180030515A (enExample) |
| CN (1) | CN107835971B (enExample) |
| BR (1) | BR112018000796A2 (enExample) |
| CA (1) | CA2992128A1 (enExample) |
| MX (1) | MX2018000441A (enExample) |
| RU (1) | RU2721410C2 (enExample) |
| WO (1) | WO2017009181A1 (enExample) |
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2019121368A (ja) * | 2017-12-28 | 2019-07-22 | イマージョン コーポレーションImmersion Corporation | 直観的な触覚設計 |
| WO2020080433A1 (ja) * | 2018-10-19 | 2020-04-23 | ソニー株式会社 | 情報処理装置、情報処理方法、および、プログラム |
| WO2020080432A1 (ja) * | 2018-10-19 | 2020-04-23 | ソニー株式会社 | 情報処理装置、情報処理方法、および、プログラム |
| WO2021172040A1 (ja) * | 2020-02-28 | 2021-09-02 | ソニーグループ株式会社 | 情報処理装置および方法 |
| WO2023176928A1 (ja) * | 2022-03-18 | 2023-09-21 | ソニーグループ株式会社 | 情報処理装置および方法 |
| JP2023540785A (ja) * | 2020-09-14 | 2023-09-26 | インターディジタル・シーイー・パテント・ホールディングス・ソシエテ・パ・アクシオンス・シンプリフィエ | 触覚シーン表現形式 |
| US11954324B2 (en) | 2020-07-22 | 2024-04-09 | Samsung Electronics Co., Ltd. | Method for performing virtual user interaction, and device therefor |
| US12003886B2 (en) | 2018-12-26 | 2024-06-04 | Sony Group Corporation | Transmission device, transmission method, reception device, and reception method |
Families Citing this family (17)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP3112987A1 (en) * | 2015-06-29 | 2017-01-04 | Thomson Licensing | Method and schemes for perceptually driven encoding of haptic effects |
| KR101678455B1 (ko) * | 2015-10-14 | 2016-11-23 | 한국과학기술연구원 | 질감인지공간을 이용한 햅틱 속성 적용 장치 및 방법 |
| EP3652613B1 (en) | 2017-07-10 | 2023-05-17 | Telefonaktiebolaget LM Ericsson (publ) | Improved transmission of haptic input |
| WO2019041274A1 (en) | 2017-08-31 | 2019-03-07 | Sz Dji Technology Co. , Ltd. | SEMICONDUCTOR LIGHT DISTANCE LIDAR DETECTION AND ESTIMATING SYSTEM SYSTEM AND METHOD FOR IMPROVING SEMICONDUCTOR LIGHT DISTANCE DETECTION AND LODAR ESTIMATION ESTIMATION |
| US10698490B2 (en) * | 2018-01-10 | 2020-06-30 | Jonathan Fraser SIMMONS | Haptic feedback device, method and system |
| CN111712779B (zh) * | 2018-02-20 | 2025-04-15 | 索尼公司 | 信息处理装置、信息处理方法和程序 |
| DE112019004540T5 (de) | 2018-09-11 | 2021-08-05 | Sony Corporation | Informationsverarbeitungsvorrichtung, informationsverarbeitungsverfahren und aufzeichnungsmedium |
| WO2020158596A1 (ja) * | 2019-02-01 | 2020-08-06 | ソニー株式会社 | 復号装置、復号方法、及びプログラム |
| US11698680B2 (en) * | 2020-06-23 | 2023-07-11 | Immersion Corporation | Methods and systems for decoding and rendering a haptic effect associated with a 3D environment |
| TWI831081B (zh) * | 2021-11-11 | 2024-02-01 | 國立陽明交通大學 | 模組化氣動體感裝置 |
| KR20240113570A (ko) * | 2021-12-03 | 2024-07-22 | 인터디지털 씨이 페이튼트 홀딩스, 에스에이에스 | 디바이스 능력들에 대한 햅틱 신호의 적응 |
| US11775072B1 (en) | 2022-04-13 | 2023-10-03 | Immersion Corportion | Methods and systems for distributing and/or generating a haptic effect associated with video content and/or audio content |
| US20250370542A1 (en) * | 2022-07-01 | 2025-12-04 | Go Touch Vr | Method and apparatus of transmitting haptic data |
| US20240127680A1 (en) * | 2022-10-18 | 2024-04-18 | Tencent America LLC | Method and apparatus for timed referenced access unit packetization of haptics elementary streams |
| CN118450207A (zh) * | 2023-02-03 | 2024-08-06 | 腾讯科技(深圳)有限公司 | 一种触觉媒体的数据处理方法及相关设备 |
| US20240346893A1 (en) * | 2023-04-17 | 2024-10-17 | Tencent America LLC | Method for carriage of binary wavelet streams in haptics interchange format |
| US20250371788A1 (en) * | 2024-05-29 | 2025-12-04 | Microsoft Technology Licensing, Llc | Render estimating engine(s) for remote content generation |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2002125999A (ja) * | 2000-10-25 | 2002-05-08 | Nippon Hoso Kyokai <Nhk> | 多感覚情報送信装置及び多感覚情報受信装置 |
| JP2013524351A (ja) * | 2010-03-31 | 2013-06-17 | イマージョン コーポレーション | 位置に基づいて触覚刺激を提供するシステム及び方法 |
| WO2015095754A1 (en) * | 2013-12-20 | 2015-06-25 | Qualcomm Incorporated | Systems, methods, and apparatus for digital composition and/or retrieval |
Family Cites Families (21)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US3983640A (en) | 1974-11-06 | 1976-10-05 | The Singer Company | Advanced G seat for aircraft simulation |
| US7667700B1 (en) * | 2004-03-05 | 2010-02-23 | Hrl Laboratories, Llc | System and method for navigating operating in a virtual environment |
| US20060284834A1 (en) | 2004-06-29 | 2006-12-21 | Sensable Technologies, Inc. | Apparatus and methods for haptic rendering using a haptic camera view |
| JP4795091B2 (ja) * | 2006-04-21 | 2011-10-19 | キヤノン株式会社 | 情報処理方法および装置 |
| RU2009116275A (ru) | 2006-09-29 | 2010-11-10 | ЭлДжи ЭЛЕКТРОНИКС ИНК. (KR) | Способы и устройства кодирования и декодирования объектно-ориентированных аудиосигналов |
| US8952888B2 (en) * | 2008-05-09 | 2015-02-10 | Koninklijke Philips N.V. | Method and system for conveying an emotion |
| JP5502348B2 (ja) | 2009-03-12 | 2014-05-28 | ファナック株式会社 | シミュレーション方法 |
| US8009022B2 (en) * | 2009-05-29 | 2011-08-30 | Microsoft Corporation | Systems and methods for immersive interaction with virtual objects |
| US8659658B2 (en) * | 2010-02-09 | 2014-02-25 | Microsoft Corporation | Physical interaction zone for gesture-based user interfaces |
| KR101108145B1 (ko) | 2010-05-07 | 2012-02-06 | 광주과학기술원 | 고해상도 타일드 디스플레이를 지원하는 햅틱기반 네트워크 가상환경 구현 장치 및 방법 |
| US20130208899A1 (en) | 2010-10-13 | 2013-08-15 | Microsoft Corporation | Skeletal modeling for positioning virtual object sounds |
| US9480907B2 (en) * | 2011-03-02 | 2016-11-01 | Microsoft Technology Licensing, Llc | Immersive display with peripheral illusions |
| US9478067B1 (en) * | 2011-04-08 | 2016-10-25 | Amazon Technologies, Inc. | Augmented reality environment with secondary sensory feedback |
| US10013857B2 (en) * | 2011-12-21 | 2018-07-03 | Qualcomm Incorporated | Using haptic technologies to provide enhanced media experiences |
| KR101546654B1 (ko) | 2012-06-26 | 2015-08-25 | 한국과학기술원 | 웨어러블 증강현실 환경에서 증강현실 서비스 제공 방법 및 장치 |
| US8532675B1 (en) * | 2012-06-27 | 2013-09-10 | Blackberry Limited | Mobile communication device user interface for manipulation of data items in a physical space |
| US9836150B2 (en) * | 2012-11-20 | 2017-12-05 | Immersion Corporation | System and method for feedforward and feedback with haptic effects |
| US9230368B2 (en) * | 2013-05-23 | 2016-01-05 | Microsoft Technology Licensing, Llc | Hologram anchoring and dynamic positioning |
| US9274603B2 (en) * | 2013-05-24 | 2016-03-01 | Immersion Corporation | Method and apparatus to provide haptic feedback based on media content and one or more external parameters |
| CN103543830B (zh) | 2013-10-28 | 2017-02-15 | 四川大学 | 一种人体骨骼点映射至立体显示中虚拟三维空间点的方法 |
| US9349378B2 (en) * | 2013-11-19 | 2016-05-24 | Dolby Laboratories Licensing Corporation | Haptic signal synthesis and transport in a bit stream |
-
2015
- 2015-07-13 EP EP15306156.9A patent/EP3118723A1/en not_active Withdrawn
-
2016
- 2016-07-07 CA CA2992128A patent/CA2992128A1/en not_active Abandoned
- 2016-07-07 US US15/742,722 patent/US11964200B2/en active Active
- 2016-07-07 MX MX2018000441A patent/MX2018000441A/es unknown
- 2016-07-07 CN CN201680040980.5A patent/CN107835971B/zh active Active
- 2016-07-07 RU RU2018105082A patent/RU2721410C2/ru active
- 2016-07-07 BR BR112018000796-0A patent/BR112018000796A2/pt not_active IP Right Cessation
- 2016-07-07 KR KR1020187000859A patent/KR20180030515A/ko not_active Withdrawn
- 2016-07-07 EP EP16738389.2A patent/EP3323032A1/en not_active Ceased
- 2016-07-07 JP JP2018500919A patent/JP2018527655A/ja active Pending
- 2016-07-07 WO PCT/EP2016/066157 patent/WO2017009181A1/en not_active Ceased
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2002125999A (ja) * | 2000-10-25 | 2002-05-08 | Nippon Hoso Kyokai <Nhk> | 多感覚情報送信装置及び多感覚情報受信装置 |
| JP2013524351A (ja) * | 2010-03-31 | 2013-06-17 | イマージョン コーポレーション | 位置に基づいて触覚刺激を提供するシステム及び方法 |
| WO2015095754A1 (en) * | 2013-12-20 | 2015-06-25 | Qualcomm Incorporated | Systems, methods, and apparatus for digital composition and/or retrieval |
Cited By (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2019121368A (ja) * | 2017-12-28 | 2019-07-22 | イマージョン コーポレーションImmersion Corporation | 直観的な触覚設計 |
| JP7424301B2 (ja) | 2018-10-19 | 2024-01-30 | ソニーグループ株式会社 | 情報処理装置、情報処理方法、および、プログラム |
| WO2020080432A1 (ja) * | 2018-10-19 | 2020-04-23 | ソニー株式会社 | 情報処理装置、情報処理方法、および、プログラム |
| JPWO2020080433A1 (ja) * | 2018-10-19 | 2021-09-09 | ソニーグループ株式会社 | 情報処理装置、情報処理方法、および、プログラム |
| JPWO2020080432A1 (ja) * | 2018-10-19 | 2021-09-16 | ソニーグループ株式会社 | 情報処理装置、情報処理方法、および、プログラム |
| US11738262B2 (en) | 2018-10-19 | 2023-08-29 | Sony Group Corporation | Information processor, information processing method, and program |
| WO2020080433A1 (ja) * | 2018-10-19 | 2020-04-23 | ソニー株式会社 | 情報処理装置、情報処理方法、および、プログラム |
| JP7452430B2 (ja) | 2018-10-19 | 2024-03-19 | ソニーグループ株式会社 | 情報処理装置、情報処理方法、および、プログラム |
| US12141357B2 (en) | 2018-10-19 | 2024-11-12 | Sony Group Corporation | Information processor, information processing method, and program |
| US12003886B2 (en) | 2018-12-26 | 2024-06-04 | Sony Group Corporation | Transmission device, transmission method, reception device, and reception method |
| WO2021172040A1 (ja) * | 2020-02-28 | 2021-09-02 | ソニーグループ株式会社 | 情報処理装置および方法 |
| US11954324B2 (en) | 2020-07-22 | 2024-04-09 | Samsung Electronics Co., Ltd. | Method for performing virtual user interaction, and device therefor |
| JP2023540785A (ja) * | 2020-09-14 | 2023-09-26 | インターディジタル・シーイー・パテント・ホールディングス・ソシエテ・パ・アクシオンス・シンプリフィエ | 触覚シーン表現形式 |
| WO2023176928A1 (ja) * | 2022-03-18 | 2023-09-21 | ソニーグループ株式会社 | 情報処理装置および方法 |
Also Published As
| Publication number | Publication date |
|---|---|
| RU2721410C2 (ru) | 2020-05-19 |
| WO2017009181A1 (en) | 2017-01-19 |
| RU2018105082A (ru) | 2019-08-13 |
| EP3323032A1 (en) | 2018-05-23 |
| CA2992128A1 (en) | 2017-01-19 |
| US11964200B2 (en) | 2024-04-23 |
| KR20180030515A (ko) | 2018-03-23 |
| EP3118723A1 (en) | 2017-01-18 |
| US20180200619A1 (en) | 2018-07-19 |
| RU2018105082A3 (enExample) | 2019-12-17 |
| CN107835971A (zh) | 2018-03-23 |
| MX2018000441A (es) | 2018-05-17 |
| CN107835971B (zh) | 2023-06-20 |
| BR112018000796A2 (pt) | 2018-09-04 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11964200B2 (en) | Method and apparatus for providing haptic feedback and interactivity based on user haptic space (HapSpace) | |
| JP7447293B2 (ja) | 異種クライアントエンドポイントへのストリーミングのための2dビデオの適応のためのニューラルネットワークモデルの参照 | |
| CN113891117A (zh) | 沉浸媒体的数据处理方法、装置、设备及可读存储介质 | |
| US20220201055A1 (en) | Reference of neural network model by immersive media for adaptation of media for streaming to heterogenous client end-points | |
| US20250138639A1 (en) | Location-based haptic signal compression | |
| US10536682B2 (en) | Method for reproducing an item of audiovisual content having haptic actuator control parameters and device implementing the method | |
| US10440446B2 (en) | Method for generating haptic coefficients using an autoregressive model, signal and device for reproducing such coefficients | |
| KR20220110787A (ko) | 이기종 클라이언트 종단점에 대한 스트리밍을 위한 2d 비디오의 적응 | |
| US10096213B2 (en) | Signal for carrying washout request in haptic audiovisual content, related method and device | |
| JP2023518676A (ja) | 没入型メディアの設置、及び没入型メディアから異種クライアントエンドポイントへの配信 | |
| CN115002470B (zh) | 一种媒体数据处理方法、装置、设备以及可读存储介质 | |
| US11937070B2 (en) | Layered description of space of interest | |
| KR20250002566A (ko) | 햅틱 텍스처를 위한 밉맵 | |
| KR20210056414A (ko) | 혼합 현실 환경들에서 오디오-가능 접속된 디바이스들을 제어하기 위한 시스템 | |
| Takada et al. | Design of Digital Twin Architecture for 3D Audio Representation in AR | |
| CN115037943B (zh) | 一种媒体数据处理方法、装置、设备以及可读存储介质 | |
| US20250271935A1 (en) | Haptics effect comprising a washout | |
| KR20250155533A (ko) | 햅틱 효과와 관련된 시맨틱 정보를 계층적으로 인코딩하기 위한 방법 및 장치 | |
| CN116490922A (zh) | 声学场景和视觉场景的一致性 | |
| CN118317066A (zh) | 一种触觉媒体的数据处理方法及相关设备 | |
| HK40070655B (zh) | 用於显示视频内容的方法和相关装置 | |
| HK40064620B (en) | Data processing method, apparatus, device and readable storage medium for immersive media | |
| HK40075536A (en) | Reference of neural network model by immersive media for adaptation of media for streaming to heterogenous client end-points | |
| HK40070655A (en) | Method and related device for displaying video content | |
| HK40086884A (zh) | 沉浸媒体的数据处理方法、装置、设备及可读存储介质 |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| RD03 | Notification of appointment of power of attorney |
Free format text: JAPANESE INTERMEDIATE CODE: A7423 Effective date: 20180223 |
|
| RD03 | Notification of appointment of power of attorney |
Free format text: JAPANESE INTERMEDIATE CODE: A7423 Effective date: 20181220 |
|
| RD04 | Notification of resignation of power of attorney |
Free format text: JAPANESE INTERMEDIATE CODE: A7424 Effective date: 20181227 |
|
| A521 | Request for written amendment filed |
Free format text: JAPANESE INTERMEDIATE CODE: A523 Effective date: 20190705 |
|
| A621 | Written request for application examination |
Free format text: JAPANESE INTERMEDIATE CODE: A621 Effective date: 20190705 |
|
| A711 | Notification of change in applicant |
Free format text: JAPANESE INTERMEDIATE CODE: A711 Effective date: 20191111 |
|
| A977 | Report on retrieval |
Free format text: JAPANESE INTERMEDIATE CODE: A971007 Effective date: 20200817 |
|
| A131 | Notification of reasons for refusal |
Free format text: JAPANESE INTERMEDIATE CODE: A131 Effective date: 20200903 |
|
| A521 | Request for written amendment filed |
Free format text: JAPANESE INTERMEDIATE CODE: A523 Effective date: 20201201 |
|
| A02 | Decision of refusal |
Free format text: JAPANESE INTERMEDIATE CODE: A02 Effective date: 20210422 |