CN104049749B - 产生来自视频内容分析的触觉反馈的方法和设备 - Google Patents

产生来自视频内容分析的触觉反馈的方法和设备 Download PDF

Info

Publication number
CN104049749B
CN104049749B CN201410190360.2A CN201410190360A CN104049749B CN 104049749 B CN104049749 B CN 104049749B CN 201410190360 A CN201410190360 A CN 201410190360A CN 104049749 B CN104049749 B CN 104049749B
Authority
CN
China
Prior art keywords
movement
estimation
videos
sensor information
image capture
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CN201410190360.2A
Other languages
English (en)
Chinese (zh)
Other versions
CN104049749A (zh
Inventor
J·萨布尼
J·M·克鲁兹-埃尔南德斯
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Immersion Corp
Original Assignee
Immersion Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Immersion Corp filed Critical Immersion Corp
Priority to CN201910795127.XA priority Critical patent/CN110536162A/zh
Publication of CN104049749A publication Critical patent/CN104049749A/zh
Application granted granted Critical
Publication of CN104049749B publication Critical patent/CN104049749B/zh
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/4302—Content synchronisation processes, e.g. decoder synchronisation
    • H04N21/4307—Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen
    • H04N21/43072—Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen of multiple content streams on the same device
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/016—Input arrangements with force or tactile feedback as computer generated output to the user
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/20—Analysis of motion
    • G—PHYSICS
    • G08—SIGNALLING
    • G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B6/00—Tactile signalling systems, e.g. personal calling systems
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/435—Processing of additional data, e.g. decrypting of additional data, reconstructing software from modules extracted from the transport stream
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/83—Generation or processing of protective or descriptive data associated with content; Content structuring
    • H04N21/845—Structuring of content, e.g. decomposing content into time segments
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/14—Picture signal circuitry for video frequency region
    • H04N5/144—Movement detection
    • H04N5/145—Movement estimation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N9/00—Details of colour television systems
    • H04N9/79—Processing of colour television signals in connection with recording

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Human Computer Interaction (AREA)
  • User Interface Of Digital Computer (AREA)
  • Image Analysis (AREA)
CN201410190360.2A 2013-03-15 2014-03-14 产生来自视频内容分析的触觉反馈的方法和设备 Expired - Fee Related CN104049749B (zh)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910795127.XA CN110536162A (zh) 2013-03-15 2014-03-14 产生来自视频内容分析的触觉反馈的方法和设备

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US13/843,092 2013-03-15
US13/843,092 US9064385B2 (en) 2013-03-15 2013-03-15 Method and apparatus to generate haptic feedback from video content analysis

Related Child Applications (1)

Application Number Title Priority Date Filing Date
CN201910795127.XA Division CN110536162A (zh) 2013-03-15 2014-03-14 产生来自视频内容分析的触觉反馈的方法和设备

Publications (2)

Publication Number Publication Date
CN104049749A CN104049749A (zh) 2014-09-17
CN104049749B true CN104049749B (zh) 2019-09-20

Family

ID=50478171

Family Applications (2)

Application Number Title Priority Date Filing Date
CN201410190360.2A Expired - Fee Related CN104049749B (zh) 2013-03-15 2014-03-14 产生来自视频内容分析的触觉反馈的方法和设备
CN201910795127.XA Pending CN110536162A (zh) 2013-03-15 2014-03-14 产生来自视频内容分析的触觉反馈的方法和设备

Family Applications After (1)

Application Number Title Priority Date Filing Date
CN201910795127.XA Pending CN110536162A (zh) 2013-03-15 2014-03-14 产生来自视频内容分析的触觉反馈的方法和设备

Country Status (5)

Country Link
US (3) US9064385B2 (enrdf_load_stackoverflow)
EP (2) EP2779675B1 (enrdf_load_stackoverflow)
JP (2) JP6456593B2 (enrdf_load_stackoverflow)
KR (1) KR20140113495A (enrdf_load_stackoverflow)
CN (2) CN104049749B (enrdf_load_stackoverflow)

Families Citing this family (63)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2014183559A (ja) * 2013-03-21 2014-09-29 Casio Comput Co Ltd 報知制御装置、報知制御方法及びプログラム
US9703379B2 (en) 2013-08-20 2017-07-11 Xsync Technologies Llc Systems and methods for multimedia tactile augmentation
US10248206B2 (en) 2013-08-20 2019-04-02 Xsync Technologies Llc Systems and methods for multimedia tactile augmentation
US9576445B2 (en) 2013-09-06 2017-02-21 Immersion Corp. Systems and methods for generating haptic effects associated with an envelope in audio signals
US9652945B2 (en) * 2013-09-06 2017-05-16 Immersion Corporation Method and system for providing haptic effects based on information complementary to multimedia content
US9619980B2 (en) 2013-09-06 2017-04-11 Immersion Corporation Systems and methods for generating haptic effects associated with audio signals
CN105745915B (zh) * 2013-09-06 2019-02-15 索尼公司 图像拍摄装置、方法和程序
WO2015035566A1 (en) * 2013-09-11 2015-03-19 Intel Corporation Integrated presentation of secondary content
US9112940B2 (en) * 2013-11-25 2015-08-18 VideoGorillas LLC Correlating sensor inputs with content stream intervals and selectively requesting and transmitting content streams
EP3167350A4 (en) 2014-07-07 2018-01-24 Immersion Corporation Second screen haptics
US9719759B2 (en) * 2014-09-19 2017-08-01 ARC Technology, LLC Haptic feedback device for simulator
US9879958B2 (en) 2014-09-19 2018-01-30 ARC Technology, LLC Haptic feedback spark device for simulator
KR102254705B1 (ko) * 2014-09-19 2021-05-24 삼성전자주식회사 단말 장치 및 그 제어방법
US10166466B2 (en) 2014-12-11 2019-01-01 Elwha Llc Feedback for enhanced situational awareness
US10449445B2 (en) * 2014-12-11 2019-10-22 Elwha Llc Feedback for enhanced situational awareness
US9919208B2 (en) * 2014-12-11 2018-03-20 Immersion Corporation Video gameplay haptics
US9600076B2 (en) * 2014-12-19 2017-03-21 Immersion Corporation Systems and methods for object manipulation with haptic feedback
US9658693B2 (en) 2014-12-19 2017-05-23 Immersion Corporation Systems and methods for haptically-enabled interactions with objects
US10225442B2 (en) * 2015-02-16 2019-03-05 Mediatek Inc. Electronic device and method for sensing air quality
US10216277B2 (en) * 2015-02-25 2019-02-26 Immersion Corporation Modifying haptic effects for slow motion
KR20160135552A (ko) * 2015-05-18 2016-11-28 삼성전자주식회사 가상 현실 장치 및 피드백 장치, 실감형 서비스 제공 시스템 및 방법
JP6641731B2 (ja) * 2015-06-05 2020-02-05 ソニー株式会社 送信装置及び送信方法、並びに受信装置及び受信方法
KR102414356B1 (ko) * 2015-06-26 2022-06-29 삼성전자 주식회사 전자 장치 및 그의 햅틱 피드백 제공 방법
US9734866B2 (en) 2015-09-25 2017-08-15 Intel Corporation Perceptual computing input to determine post-production effects
US20170090577A1 (en) * 2015-09-25 2017-03-30 Immersion Corporation Haptic effects design system
US20180046250A1 (en) * 2016-08-09 2018-02-15 Wipro Limited System and method for providing and modulating haptic feedback
US20180067335A1 (en) * 2016-09-07 2018-03-08 Google Inc. Optical image stabilization for folded optics camera modules
US10102723B2 (en) * 2016-10-31 2018-10-16 Immersion Corporation Dynamic haptic generation based on detected video events
CN106534142B (zh) * 2016-11-22 2018-04-20 包磊 多媒体数据的实时传输方法及装置
CN106454365B (zh) * 2016-11-22 2018-07-10 包磊 多媒体数据的编码、解码方法及编码、解码装置
US10600290B2 (en) * 2016-12-14 2020-03-24 Immersion Corporation Automatic haptic generation based on visual odometry
US10101813B2 (en) * 2016-12-14 2018-10-16 Immersion Corporation Automatic haptic generation based on color features and motion analysis
US11337456B2 (en) 2017-07-17 2022-05-24 Rai Strategic Holdings, Inc. Video analytics camera system for an aerosol delivery device
US10503310B2 (en) 2017-09-20 2019-12-10 Alex Hamid Mani Assistive device for non-visually discerning a three-dimensional (3D) real-world area surrounding a user
US11513627B2 (en) 2017-09-20 2022-11-29 Niki Mani Assistive device with a refreshable haptic feedback interface
US11726571B2 (en) 2017-09-20 2023-08-15 Niki Mani Assistive device for non-visually discerning a three-dimensional (3D) real-world area surrounding a user
US10281983B2 (en) * 2017-09-20 2019-05-07 Alex Hamid Mani Haptic feedback device and method for providing haptic sensation based on video
US10275083B2 (en) 2017-09-20 2019-04-30 Alex Hamid Mani Assistive device with a refreshable haptic feedback interface
US11561619B2 (en) 2017-09-20 2023-01-24 Niki Mani Haptic feedback device and method for providing haptic sensation based on video
NL2020023B1 (en) * 2017-12-05 2019-06-13 Feel Robotics B V Method and apparatus for adding a control signal for an auxiliary device to a sexually arousing video movie
CN108399642B (zh) * 2018-01-26 2021-07-27 上海深视信息科技有限公司 一种融合旋翼无人机imu数据的通用目标跟随方法和系统
US10832537B2 (en) * 2018-04-04 2020-11-10 Cirrus Logic, Inc. Methods and apparatus for outputting a haptic signal to a haptic transducer
DE112018007442B4 (de) 2018-05-11 2021-10-14 Mitsubishi Electric Corporation Datensynchronisationsvorrichtung, datensynchronisationsverfahren und datensynchronisationsprogramm
US20200012347A1 (en) * 2018-07-09 2020-01-09 Immersion Corporation Systems and Methods for Providing Automatic Haptic Generation for Video Content
US11656683B2 (en) * 2018-08-10 2023-05-23 Sony Corporation Signal generation device, signal generation method, and reproduction device
US11197074B2 (en) * 2018-09-24 2021-12-07 Brian Sloan Synchronized video annotation and control system for sexual stimulation devices
US10638174B2 (en) * 2018-09-24 2020-04-28 Brian Sloan Synchronized video control system for sexual stimulation devices
US11185465B2 (en) * 2018-09-24 2021-11-30 Brian Sloan Automated generation of control signals for sexual stimulation devices
WO2020153194A1 (ja) * 2019-01-23 2020-07-30 ソニー株式会社 情報処理装置、情報処理方法及びプログラム
US20220113801A1 (en) * 2019-04-26 2022-04-14 Hewlett-Packard Development Company, L.P. Spatial audio and haptics
WO2020258319A1 (zh) * 2019-06-28 2020-12-30 瑞声声学科技(深圳)有限公司 触感信号生成方法、装置和计算机设备
US11422625B2 (en) 2019-12-31 2022-08-23 Human Mode, L.L.C. Proxy controller suit with optional dual range kinematics
CN111610856B (zh) * 2020-04-30 2024-04-26 北京小米移动软件有限公司 震动反馈方法、震动反馈装置及存储介质
US11755643B2 (en) 2020-07-06 2023-09-12 Microsoft Technology Licensing, Llc Metadata generation for video indexing
JP6839783B1 (ja) * 2020-09-29 2021-03-10 Dmg森精機株式会社 回転速度判定装置
JP7502957B2 (ja) * 2020-10-08 2024-06-19 日本放送協会 触覚メタデータ生成装置、映像触覚連動システム、及びプログラム
CN114694545B (zh) * 2020-12-30 2023-11-24 成都极米科技股份有限公司 图像显示方法、装置、投影仪及存储介质
CN113436261B (zh) * 2021-06-24 2022-04-29 湖南大学 一种面向封闭园区自动驾驶的单目视觉惯性定位方法
KR102505225B1 (ko) * 2021-10-22 2023-03-02 (주)인티그리트 시각화된 가상 안내 정보를 제공하는 자율주행장치 및 이의 동작방법
CN115758107B (zh) * 2022-10-28 2023-11-14 中国电信股份有限公司 触觉信号传输方法及装置、存储介质及电子设备
WO2024101688A1 (ko) * 2022-11-10 2024-05-16 삼성전자주식회사 미디어 콘텐트로부터 햅틱 정보를 획득하기 위한 전자 장치 및 그 방법
WO2025110455A1 (ko) * 2023-11-22 2025-05-30 삼성전자주식회사 모션을 가이드하기 위한 햅틱 데이터를 제공하는 전자 장치 및 방법
KR20250126895A (ko) * 2024-02-16 2025-08-26 사회복지법인 삼성생명공익재단 약제를 자동으로 인식 및 검수하기 위한 방법 및 장치

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101910977A (zh) * 2007-12-28 2010-12-08 诺基亚公司 基于视觉环境的音频和触觉反馈
CN102227694A (zh) * 2008-10-10 2011-10-26 因特网服务有限责任公司 供触觉编码的媒体使用的触觉输出装置
CN102473172A (zh) * 2009-07-24 2012-05-23 数字标记公司 改进的音频/视频方法和系统

Family Cites Families (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2003009177A (ja) * 2001-06-21 2003-01-10 For-A Co Ltd 画像合成システム
JP2003099177A (ja) * 2001-09-21 2003-04-04 Fuji Xerox Co Ltd 触覚情報作成方法、触覚情報提示方法および触覚情報提示装置
JP4078365B2 (ja) * 2005-07-13 2008-04-23 キヤノン株式会社 画像処理装置およびその制御方法
US8700791B2 (en) * 2005-10-19 2014-04-15 Immersion Corporation Synchronization of haptic effect data in a media transport stream
CN104063056B (zh) * 2006-04-06 2018-04-20 意美森公司 用于增强的触觉效果的系统和方法
US7979146B2 (en) * 2006-04-13 2011-07-12 Immersion Corporation System and method for automatically producing haptic events from a digital audio signal
KR20090057268A (ko) * 2006-08-24 2009-06-04 코닌클리케 필립스 일렉트로닉스 엔.브이. 햅틱 여기를 발생하기 위해 오디오 신호 및/또는 비디오 신호를 처리하기 위한 디바이스 및 방법
KR20080048308A (ko) * 2006-11-28 2008-06-02 삼성전자주식회사 기본 장치와 확장 장치의 연동 장치 및 방법
US9019087B2 (en) * 2007-10-16 2015-04-28 Immersion Corporation Synchronization of haptic effect data in a media stream
US8300117B2 (en) * 2008-03-28 2012-10-30 Fuji Xerox Co., Ltd. System and method for exposing video-taking heuristics at point of capture
US9400555B2 (en) * 2008-10-10 2016-07-26 Internet Services, Llc System and method for synchronization of haptic data and media data
WO2011007289A2 (en) 2009-07-17 2011-01-20 Koninklijke Philips Electronics N.V. A method and a system for a generation of an excitation effect
ES2364999B1 (es) * 2009-09-07 2012-08-07 Juan Zarza Goyenechea Dispositivo publicitario y probador de visionado con perspectiva.
JP2013047878A (ja) * 2011-08-29 2013-03-07 Toshiba Corp 道路状況把握装置

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101910977A (zh) * 2007-12-28 2010-12-08 诺基亚公司 基于视觉环境的音频和触觉反馈
CN102227694A (zh) * 2008-10-10 2011-10-26 因特网服务有限责任公司 供触觉编码的媒体使用的触觉输出装置
CN102473172A (zh) * 2009-07-24 2012-05-23 数字标记公司 改进的音频/视频方法和系统

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
A Framework for Enhancing Video Viewing Experience;Fabien Danieau等;《HAPTICS SYMPOSIUM (HAPTICS),2012 IEEE》;20120307;542-543页 *

Also Published As

Publication number Publication date
EP2779675A3 (en) 2015-03-04
EP3570553B1 (en) 2021-05-19
KR20140113495A (ko) 2014-09-24
EP2779675B1 (en) 2019-07-10
CN104049749A (zh) 2014-09-17
JP6456593B2 (ja) 2019-01-23
JP6559316B2 (ja) 2019-08-14
US10482608B2 (en) 2019-11-19
US9064385B2 (en) 2015-06-23
US9911196B2 (en) 2018-03-06
US20150262376A1 (en) 2015-09-17
US20140267904A1 (en) 2014-09-18
US20180144480A1 (en) 2018-05-24
JP2014194765A (ja) 2014-10-09
JP2019036351A (ja) 2019-03-07
EP2779675A2 (en) 2014-09-17
CN110536162A (zh) 2019-12-03
EP3570553A1 (en) 2019-11-20

Similar Documents

Publication Publication Date Title
CN104049749B (zh) 产生来自视频内容分析的触觉反馈的方法和设备
US12026806B2 (en) Systems and methods for utilizing a living entity as a marker for augmented reality content
CN108369742B (zh) 使用传感器融合的经优化对象扫描
CN103139463B (zh) 扩增实境的方法、系统及移动装置
CA3025525C (en) Digital camera with audio, visual and motion analysis
EP3532797A1 (en) Curated photogrammetry
KR20170031733A (ko) 디스플레이를 위한 캡처된 이미지의 시각을 조정하는 기술들
JP2016502712A (ja) 単眼視覚ｓｌａｍのための高速初期化
KR101647969B1 (ko) 사용자 시선을 검출하기 위한 사용자 시선 검출 장치 및 그 방법과, 그 방법을 실행하기 위한 컴퓨터 프로그램
KR20150130483A (ko) 평면의 자연스러운 특성 타겟들의 인시츄 생성
JP2015079444A5 (enrdf_load_stackoverflow)
CN113228117B (zh) 创作装置、创作方法和记录有创作程序的记录介质
JP7293362B2 (ja) 撮影方法、装置、電子機器及び記憶媒体
Afif et al. Orientation control for indoor virtual landmarks based on hybrid-based markerless augmented reality
US20200211275A1 (en) Information processing device, information processing method, and recording medium
KR20220083166A (ko) 인체 추정 방법 및 장치
WO2020255408A1 (ja) 撮影データ生成装置、撮影データ生成方法及びプログラム
JP2019045211A (ja) 情報処理装置、情報処理方法及びコンピュータプログラム
CN206892844U (zh) 一种三维成像的led显示屏
TH10772A3 (th) "ระบบถ่ายภาพสิ่งมีชีวิตที่จำลองการสวมเครื่องประดับ 3 มิติ บนศีรษะด้วยเทคโนโลยีเสมือน"
TH10772C3 (th) "ระบบถ่ายภาพสิ่งมีชีวิตที่จำลองการสวมเครื่องประดับ 3 มิติ บนศีรษะด้วยเทคโนโลยีเสมือน"

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C53 Correction of patent of invention or patent application
CB02 Change of applicant information

Address after: California, USA

Applicant after: Immersion Corp.

Address before: California, USA

Applicant before: Immersion Corp.

COR Change of bibliographic data

Free format text: CORRECT: APPLICANT; FROM: IMMERSION CORP. TO: YIMEISEN COMPANY

C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20190920