CN104049889B - 用于编码和解码多媒体文件中的触觉信息的方法和设备 - Google Patents

用于编码和解码多媒体文件中的触觉信息的方法和设备 Download PDF

Info

Publication number
CN104049889B
CN104049889B CN201410096022.2A CN201410096022A CN104049889B CN 104049889 B CN104049889 B CN 104049889B CN 201410096022 A CN201410096022 A CN 201410096022A CN 104049889 B CN104049889 B CN 104049889B
Authority
CN
China
Prior art keywords
haptic
signal
content
frequency
encoding
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CN201410096022.2A
Other languages
English (en)
Chinese (zh)
Other versions
CN104049889A (zh
Inventor
A·瑟恩
C·J·乌尔里奇
J·M·克鲁兹-埃尔南德斯
A·莫达里斯
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Immersion Corp
Original Assignee
Immersion Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Immersion Corp filed Critical Immersion Corp
Priority to CN201911250930.1A priority Critical patent/CN111026271A/zh
Publication of CN104049889A publication Critical patent/CN104049889A/zh
Application granted granted Critical
Publication of CN104049889B publication Critical patent/CN104049889B/zh
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/4104—Peripherals receiving signals from specially adapted client devices
    • H04N21/4126—The peripheral being portable, e.g. PDAs or mobile phones
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/16—Sound input; Sound output
    • G06F3/165—Management of the audio stream, e.g. setting of volume, audio stream path
    • G—PHYSICS
    • G11—INFORMATION STORAGE
    • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B31/00—Arrangements for the associated working of recording or reproducing apparatus with related apparatus
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/422—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
    • H04N21/42203—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS] sound input device, e.g. microphone
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/439—Processing of audio elementary streams
    • H04N21/4394—Processing of audio elementary streams involving operations for analysing the audio stream, e.g. detecting features or characteristics in audio streams
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/85—Assembly of content; Generation of multimedia applications
    • H04N21/854—Content authoring
    • H04N21/85406—Content authoring involving a specific file format, e.g. MP4 format
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N9/00—Details of colour television systems
    • H04N9/79—Processing of colour television signals in connection with recording
    • H04N9/80—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback
    • H04N9/804—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback involving pulse code modulation of the colour picture signal components
    • H04N9/806—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback involving pulse code modulation of the colour picture signal components with processing of the sound signal
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N9/00—Details of colour television systems
    • H04N9/79—Processing of colour television signals in connection with recording
    • H04N9/87—Regeneration of colour television signals
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/016—Input arrangements with force or tactile feedback as computer generated output to the user

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Theoretical Computer Science (AREA)
  • General Health & Medical Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Health & Medical Sciences (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Security & Cryptography (AREA)
  • User Interface Of Digital Computer (AREA)
CN201410096022.2A 2013-03-15 2014-03-14 用于编码和解码多媒体文件中的触觉信息的方法和设备 Expired - Fee Related CN104049889B (zh)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201911250930.1A CN111026271A (zh) 2013-03-15 2014-03-14 用于编码和解码多媒体文件中的触觉信息的方法和设备

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US13/842,912 US9992491B2 (en) 2013-03-15 2013-03-15 Method and apparatus for encoding and decoding haptic information in multi-media files
US13/842,912 2013-03-15

Related Child Applications (1)

Application Number Title Priority Date Filing Date
CN201911250930.1A Division CN111026271A (zh) 2013-03-15 2014-03-14 用于编码和解码多媒体文件中的触觉信息的方法和设备

Publications (2)

Publication Number Publication Date
CN104049889A CN104049889A (zh) 2014-09-17
CN104049889B true CN104049889B (zh) 2020-01-03

Family

ID=50342181

Family Applications (2)

Application Number Title Priority Date Filing Date
CN201410096022.2A Expired - Fee Related CN104049889B (zh) 2013-03-15 2014-03-14 用于编码和解码多媒体文件中的触觉信息的方法和设备
CN201911250930.1A Pending CN111026271A (zh) 2013-03-15 2014-03-14 用于编码和解码多媒体文件中的触觉信息的方法和设备

Family Applications After (1)

Application Number Title Priority Date Filing Date
CN201911250930.1A Pending CN111026271A (zh) 2013-03-15 2014-03-14 用于编码和解码多媒体文件中的触觉信息的方法和设备

Country Status (5)

Country Link
US (3) US9992491B2 (enExample)
EP (2) EP2778901B1 (enExample)
JP (2) JP2014182816A (enExample)
KR (1) KR20140113567A (enExample)
CN (2) CN104049889B (enExample)

Families Citing this family (37)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9652945B2 (en) * 2013-09-06 2017-05-16 Immersion Corporation Method and system for providing haptic effects based on information complementary to multimedia content
US9401079B2 (en) * 2013-09-06 2016-07-26 Immersion Corporation Method and apparatus of converting control tracks for providing haptic feedback
US9711014B2 (en) 2013-09-06 2017-07-18 Immersion Corporation Systems and methods for generating haptic effects associated with transitions in audio signals
US9576445B2 (en) 2013-09-06 2017-02-21 Immersion Corp. Systems and methods for generating haptic effects associated with an envelope in audio signals
US9619980B2 (en) 2013-09-06 2017-04-11 Immersion Corporation Systems and methods for generating haptic effects associated with audio signals
US20150293590A1 (en) * 2014-04-11 2015-10-15 Nokia Corporation Method, Apparatus, And Computer Program Product For Haptically Providing Information Via A Wearable Device
EP3167350A4 (en) 2014-07-07 2018-01-24 Immersion Corporation Second screen haptics
EP3037918A1 (en) * 2014-12-23 2016-06-29 Thomson Licensing System and method for localizing haptic effects on a body
US10269392B2 (en) * 2015-02-11 2019-04-23 Immersion Corporation Automated haptic effect accompaniment
US10427040B2 (en) 2015-06-03 2019-10-01 Razer (Asia-Pacific) Pte. Ltd. Haptics devices and methods for controlling a haptics device
US20160366450A1 (en) * 2015-06-12 2016-12-15 Immersion Corporation Broadcast haptics architectures
EP3112987A1 (en) * 2015-06-29 2017-01-04 Thomson Licensing Method and schemes for perceptually driven encoding of haptic effects
WO2017020115A1 (en) * 2015-08-05 2017-02-09 Eski Inc. Methods and apparatus for communicating with a receiving unit
KR102512840B1 (ko) * 2015-10-15 2023-03-22 삼성전자주식회사 실행 화면 레코딩 방법 및 그 방법을 처리하는 전자 장치
US9883235B2 (en) 2015-10-28 2018-01-30 At&T Intellectual Property I, L.P. Video motion augmentation
US9847000B2 (en) 2015-10-29 2017-12-19 Immersion Corporation Ambient triggered notifications for rendering haptic effects
US9788152B1 (en) 2016-04-01 2017-10-10 Eski Inc. Proximity-based configuration of a device
US10713908B2 (en) * 2016-09-30 2020-07-14 Sony Corporation Content providing system, control apparatus, and reception apparatus
JP2018092012A (ja) 2016-12-05 2018-06-14 ソニー株式会社 情報処理装置、情報処理方法、およびプログラム
JP2018101243A (ja) * 2016-12-20 2018-06-28 日本電信電話株式会社 生体電気刺激装置、生体電気刺激システムおよび電気刺激提示方法
US10147460B2 (en) * 2016-12-28 2018-12-04 Immersion Corporation Haptic effect generation for space-dependent content
JP2018185704A (ja) * 2017-04-27 2018-11-22 日本電信電話株式会社 生体電気刺激装置、生体電気刺激システムおよび生体電気刺激方法
US10541005B2 (en) * 2017-05-17 2020-01-21 Cypress Semiconductor Corporation Distributed and synchronized control system for environmental signals in multimedia playback
US11069206B2 (en) * 2018-05-04 2021-07-20 Cirrus Logic, Inc. Methods and apparatus for outputting a haptic signal to a haptic transducer
JP7155643B2 (ja) 2018-06-18 2022-10-19 ソニーグループ株式会社 情報処理装置、および情報処理方法、並びにプログラム
US20200012347A1 (en) * 2018-07-09 2020-01-09 Immersion Corporation Systems and Methods for Providing Automatic Haptic Generation for Video Content
US10916105B2 (en) 2018-09-06 2021-02-09 Bank Of America Corporation Processing system for providing enhanced reality interfaces at an automated teller machine (ATM) terminal platform
US10755250B2 (en) 2018-09-07 2020-08-25 Bank Of America Corporation Processing system for providing a teller assistant experience using enhanced reality interfaces
US10462425B1 (en) 2018-09-07 2019-10-29 Bank Of America Corporation Processing system for providing a teller assistant experience using enhanced reality interfaces
CN109451154B (zh) * 2018-10-31 2021-04-23 维沃移动通信有限公司 一种设置多媒体文件的方法及终端设备
US10984638B1 (en) * 2019-10-17 2021-04-20 Immersion Corporation Systems, devices, and methods for encoding haptic tracks
KR20220118411A (ko) 2019-12-25 2022-08-25 소니그룹주식회사 송신 장치, 송신 방법, 수신 장치 및 수신 방법
US11698680B2 (en) * 2020-06-23 2023-07-11 Immersion Corporation Methods and systems for decoding and rendering a haptic effect associated with a 3D environment
CN113206912B (zh) * 2021-04-26 2023-07-04 瑞声光电科技(常州)有限公司 多媒体信息处理方法、装置、电子设备及存储介质
WO2023018309A1 (en) * 2021-08-13 2023-02-16 Samsung Electronics Co., Ltd. A method and an apparatus for generating localized vibrations
CN119065488A (zh) * 2023-05-31 2024-12-03 腾讯科技（深圳）有限公司 触觉媒体内容的处理方法及装置、设备、存储介质
US20250349324A1 (en) * 2024-05-11 2025-11-13 Michael Joseph Hewitt Revinyl: magnetic and mechanical audio transfer for phono cartridges

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20020033795A1 (en) * 2000-01-19 2002-03-21 Shahoian Erik J. Haptic interface for laptop computers and other portable devices
US20060017691A1 (en) * 2004-07-23 2006-01-26 Juan Manuel Cruz-Hernandez System and method for controlling audio output associated with haptic effects
CN101828382A (zh) * 2007-10-16 2010-09-08 伊梅森公司 媒体传输流中的触觉效应数据的同步
US20110280551A1 (en) * 2010-05-11 2011-11-17 Cisco Technology, Inc. Unintended Video Recording Detection in a Video Recording Device
US20120306631A1 (en) * 2011-06-03 2012-12-06 Apple Inc. Audio Conversion To Vibration Patterns

Family Cites Families (21)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1240984A (zh) * 1995-01-25 2000-01-12 Dva公司 具有检查可读盘上空白扇区电路的光盘系统及其操作方法
US7623114B2 (en) * 2001-10-09 2009-11-24 Immersion Corporation Haptic feedback sensations based on audio output from computer devices
US6703550B2 (en) * 2001-10-10 2004-03-09 Immersion Corporation Sound data output and manipulation using haptic feedback
JP3879510B2 (ja) * 2001-10-11 2007-02-14 セイコーエプソン株式会社 立体表示装置
US8745132B2 (en) * 2004-09-10 2014-06-03 Silver State Intellectual Technologies, Inc. System and method for audio and video portable publishing system
US10741089B2 (en) * 2004-12-23 2020-08-11 Carl Wakamoto Interactive immersion system for movies, television, animation, music videos, language training, entertainment, video games and social networking
US8700791B2 (en) * 2005-10-19 2014-04-15 Immersion Corporation Synchronization of haptic effect data in a media transport stream
EP2002323A2 (en) * 2006-04-06 2008-12-17 Immersion Corporation Systems and methods for enhanced haptic effects
US20090079690A1 (en) * 2007-09-21 2009-03-26 Sony Computer Entertainment America Inc. Method and apparatus for enhancing entertainment software through haptic insertion
US7911328B2 (en) * 2007-11-21 2011-03-22 The Guitammer Company Capture and remote reproduction of haptic events in synchronous association with the video and audio capture and reproduction of those events
US20170188940A9 (en) * 2007-11-26 2017-07-06 Whispersom Corporation Device to detect and treat Apneas and Hypopnea
US8674941B2 (en) * 2008-12-16 2014-03-18 Dell Products, Lp Systems and methods for implementing haptics for pressure sensitive keyboards
CN101771869B (zh) * 2008-12-30 2011-09-28 深圳市万兴软件有限公司 一种音视频编解码装置及方法
US20110032088A1 (en) * 2009-08-10 2011-02-10 Electronics And Telecommunications Research Institute Method of encoding haptic information on image, method of decoding haptic information from image and apparatus of processing haptic information for the same
US8624839B2 (en) * 2009-10-15 2014-01-07 Synaptics Incorporated Support-surface apparatus to impart tactile feedback
US8902050B2 (en) * 2009-10-29 2014-12-02 Immersion Corporation Systems and methods for haptic augmentation of voice-to-text conversion
US8798534B2 (en) * 2010-07-09 2014-08-05 Digimarc Corporation Mobile devices and methods employing haptics
FR2964761B1 (fr) 2010-09-14 2012-08-31 Thales Sa Dispositif d'interaction haptique et procede de generation d'effets haptiques et sonores
WO2012090031A1 (en) 2010-12-31 2012-07-05 Nokia Corporation A display apparatus producing audio and haptic output
US20130016042A1 (en) * 2011-07-12 2013-01-17 Ville Makinen Haptic device with touch gesture interface
US9866924B2 (en) * 2013-03-14 2018-01-09 Immersion Corporation Systems and methods for enhanced television interaction

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20020033795A1 (en) * 2000-01-19 2002-03-21 Shahoian Erik J. Haptic interface for laptop computers and other portable devices
US20060017691A1 (en) * 2004-07-23 2006-01-26 Juan Manuel Cruz-Hernandez System and method for controlling audio output associated with haptic effects
CN101828382A (zh) * 2007-10-16 2010-09-08 伊梅森公司 媒体传输流中的触觉效应数据的同步
US20110280551A1 (en) * 2010-05-11 2011-11-17 Cisco Technology, Inc. Unintended Video Recording Detection in a Video Recording Device
US20120306631A1 (en) * 2011-06-03 2012-12-06 Apple Inc. Audio Conversion To Vibration Patterns

Also Published As

Publication number Publication date
JP2019032888A (ja) 2019-02-28
EP3561661A1 (en) 2019-10-30
EP2778901A1 (en) 2014-09-17
US9992491B2 (en) 2018-06-05
JP2014182816A (ja) 2014-09-29
CN104049889A (zh) 2014-09-17
US20180255294A1 (en) 2018-09-06
KR20140113567A (ko) 2014-09-24
US20140270681A1 (en) 2014-09-18
CN111026271A (zh) 2020-04-17
US10477202B2 (en) 2019-11-12
EP2778901B1 (en) 2019-06-12
US20200128236A1 (en) 2020-04-23

Similar Documents

Publication Publication Date Title
CN104049889B (zh) 用于编码和解码多媒体文件中的触觉信息的方法和设备
US10909821B2 (en) Spatialized haptic feedback based on dynamically scaled values
CN108399003B (zh) 带有选择的触觉元数据的触觉广播
US9635440B2 (en) Second screen haptics
Lee et al. Real-time perception-level translation from audio signals to vibrotactile effects
EP3206109B1 (en) Low-frequency effects haptic conversion system
US20150054727A1 (en) Haptically enabled viewing of sporting events
US11681372B2 (en) Touch enabling process, haptic accessory, and core haptic engine to enable creation and delivery of tactile-enabled experiences with virtual objects
CN106249868A (zh) 广播触觉架构
US20190267043A1 (en) Automated haptic effect accompaniment
CN113508354A (zh) 显示环境的表示
CN111903137A (zh) 基于用户的姿势混合音频
Li et al. Towards context-aware automatic haptic effect generation for home theatre environments
CN114846808A (zh) 内容发布系统、内容发布方法以及内容发布程序
CN113632060A (zh) 用于指示在虚拟空间中呈现的音频内容的可听性的设备、方法、计算机程序或系统
CN105228711A (zh) 用于再现具有触觉致动器控制参数的视听内容的项目的方法和实现该方法的装置
CN114647306A (zh) 触觉内容呈现和实现
Moule et al. A method for automatically aligning projection mapping systems

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C53 Correction of patent of invention or patent application
CB02 Change of applicant information

Address after: American California

Applicant after: Immersion Corp.

Address before: American California

Applicant before: Immersion Corp.

COR Change of bibliographic data

Free format text: CORRECT: APPLICANT; FROM: IMMERSION CORP. TO: YIMEISEN CO., LTD.

C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20200103