CN106164819B - 眼睛跟踪使能智能隐藏字幕 - Google Patents

眼睛跟踪使能智能隐藏字幕 Download PDF

Info

Publication number
CN106164819B
CN106164819B CN201580015857.3A CN201580015857A CN106164819B CN 106164819 B CN106164819 B CN 106164819B CN 201580015857 A CN201580015857 A CN 201580015857A CN 106164819 B CN106164819 B CN 106164819B
Authority
CN
China
Prior art keywords
closed caption
user
predetermined
attentively
display
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CN201580015857.3A
Other languages
English (en)
Chinese (zh)
Other versions
CN106164819A (zh
Inventor
W·威莱拉特
V·图克拉尔
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Microsoft Technology Licensing LLC
Original Assignee
Microsoft Technology Licensing LLC
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Microsoft Technology Licensing LLC filed Critical Microsoft Technology Licensing LLC
Publication of CN106164819A publication Critical patent/CN106164819A/zh
Application granted granted Critical
Publication of CN106164819B publication Critical patent/CN106164819B/zh
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/013—Eye tracking input arrangements
    • G—PHYSICS
    • G11—INFORMATION STORAGE
    • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B27/00—Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
    • G11B27/10—Indexing; Addressing; Timing or synchronising; Measuring tape travel
    • G11B27/19—Indexing; Addressing; Timing or synchronising; Measuring tape travel by using information detectable on the record carrier
    • G11B27/28—Indexing; Addressing; Timing or synchronising; Measuring tape travel by using information detectable on the record carrier by using information signals recorded by the same method as the main recording
    • G—PHYSICS
    • G11—INFORMATION STORAGE
    • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B27/00—Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
    • G11B27/10—Indexing; Addressing; Timing or synchronising; Measuring tape travel
    • G11B27/34—Indicating arrangements 
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/422—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
    • H04N21/4223—Cameras
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/442—Monitoring of processes or resources, e.g. detecting the failure of a recording device, monitoring the downstream bandwidth, the number of times a movie has been viewed, the storage space available from the internal hard disk
    • H04N21/44213—Monitoring of end-user related data
    • H04N21/44218—Detecting physical presence or behaviour of the user, e.g. using sensors to detect if the user is leaving the room or changes his face expression during a TV programme
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/488—Data services, e.g. news ticker
    • H04N21/4884—Data services, e.g. news ticker for displaying subtitles
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/76—Television signal recording
    • H04N5/84—Television signal recording using optical recording
    • H04N5/85—Television signal recording using optical recording on discs or drums
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
    • G06F2203/048—Indexing scheme relating to G06F3/048
    • G06F2203/04804—Transparency, e.g. transparent or translucent windows

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Social Psychology (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Databases & Information Systems (AREA)
  • User Interface Of Digital Computer (AREA)
  • Controls And Circuits For Display Device (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
  • Position Input By Displaying (AREA)
  • Control Of Indicators Other Than Cathode Ray Tubes (AREA)
CN201580015857.3A 2014-03-25 2015-03-20 眼睛跟踪使能智能隐藏字幕 Expired - Fee Related CN106164819B (zh)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US14/225,181 US9568997B2 (en) 2014-03-25 2014-03-25 Eye tracking enabled smart closed captioning
US14/225,181 2014-03-25
PCT/US2015/021619 WO2015148276A1 (en) 2014-03-25 2015-03-20 Eye tracking enabled smart closed captioning

Publications (2)

Publication Number Publication Date
CN106164819A CN106164819A (zh) 2016-11-23
CN106164819B true CN106164819B (zh) 2019-03-26

Family

ID=52814232

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201580015857.3A Expired - Fee Related CN106164819B (zh) 2014-03-25 2015-03-20 眼睛跟踪使能智能隐藏字幕

Country Status (11)

Country Link
US (2) US9568997B2 (enExample)
EP (1) EP3123280B1 (enExample)
JP (1) JP6461989B2 (enExample)
KR (2) KR102513711B1 (enExample)
CN (1) CN106164819B (enExample)
AU (1) AU2015236456B2 (enExample)
CA (1) CA2939955C (enExample)
MX (1) MX383736B (enExample)
RU (1) RU2676045C2 (enExample)
TW (1) TW201539255A (enExample)
WO (1) WO2015148276A1 (enExample)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2024242677A1 (en) * 2023-05-24 2024-11-28 Carefusion 303, Inc. Device, system, and method for determining and increasing clinician engagement with infusion devices

Families Citing this family (35)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9875218B2 (en) * 2014-01-28 2018-01-23 International Business Machines Corporation Document summarization
US9568997B2 (en) * 2014-03-25 2017-02-14 Microsoft Technology Licensing, Llc Eye tracking enabled smart closed captioning
KR20170041720A (ko) * 2014-08-07 2017-04-17 포브, 아이엔씨. 3차원상의 주시점의 위치 특정 알고리즘
US10317994B2 (en) * 2015-06-05 2019-06-11 International Business Machines Corporation Initiating actions responsive to user expressions of a user while reading media content
RU2718121C2 (ru) * 2015-06-30 2020-03-30 Сони Корпорейшн Приемное устройство, способ приема, передающее устройство и способ передачи
CN107852521B (zh) * 2015-08-07 2023-04-11 苹果公司 用于显示图像流的系统和方法
JP6404196B2 (ja) 2015-09-16 2018-10-10 グリー株式会社 仮想画像表示プログラム、仮想画像表示装置及び仮想画像表示方法
US10444972B2 (en) 2015-11-28 2019-10-15 International Business Machines Corporation Assisting a user with efficient navigation between a selection of entries with elements of interest to the user within a stream of entries
CN106993227B (zh) * 2016-01-20 2020-01-21 腾讯科技（北京）有限公司 一种进行信息展示的方法和装置
US20170293363A1 (en) * 2016-04-07 2017-10-12 Jeffrey Shawn McLaughlin System And Methods For Eye Gaze Triggered Control Of Appliance By Hand Gesture
CA3046329A1 (en) 2016-12-06 2018-06-14 Donn M. GURULE Systems and methods for a chronological-based search engine
JP6831228B2 (ja) * 2016-12-15 2021-02-17 株式会社Ｚ会 情報処理装置、情報処理システム及び情報処理方法
US20180302686A1 (en) * 2017-04-14 2018-10-18 International Business Machines Corporation Personalizing closed captions for video content
US10425696B2 (en) 2017-07-11 2019-09-24 Sony Corporation User placement of closed captioning
CN116185168A (zh) * 2018-07-26 2023-05-30 中兴通讯股份有限公司 一种调整多媒体信息的输出参数的方法、终端和存储介质
CN109271027B (zh) * 2018-09-17 2022-10-14 北京旷视科技有限公司 页面控制方法、装置及电子设备
JP7153522B2 (ja) * 2018-10-11 2022-10-14 日本放送協会 字幕表示装置及びそのプログラム
KR102659863B1 (ko) 2018-11-28 2024-04-24 삼성전자주식회사 전자 장치 및 그 제어 방법
US10880515B2 (en) * 2018-12-14 2020-12-29 Sony Corporation Audio-video reproduction for closed caption display control based on multi-media content
US11069368B2 (en) * 2018-12-18 2021-07-20 Colquitt Partners, Ltd. Glasses with closed captioning, voice recognition, volume of speech detection, and translation capabilities
US11087778B2 (en) * 2019-02-15 2021-08-10 Qualcomm Incorporated Speech-to-text conversion based on quality metric
CN110248241B (zh) * 2019-06-11 2021-06-04 Oppo广东移动通信有限公司 视频处理方法及相关装置
JP7346135B2 (ja) * 2019-07-30 2023-09-19 キヤノン株式会社 電子機器、電子機器の制御方法、プログラムおよび記憶媒体
CN112584280B (zh) * 2019-09-27 2022-11-29 百度在线网络技术（北京）有限公司 智能设备的控制方法、装置、设备和介质
US11070891B1 (en) * 2019-12-10 2021-07-20 Amazon Technologies, Inc. Optimization of subtitles for video content
CN113672132A (zh) * 2020-05-13 2021-11-19 聚好看科技股份有限公司 一种文本框控件显示位置的调整方法及显示设备
TWI755037B (zh) * 2020-08-21 2022-02-11 陳筱涵 影音錄製裝置與影音編輯播放系統
US12210553B2 (en) * 2021-06-28 2025-01-28 Adeia Guides Inc. Subtitle rendering based on the reading pace
US11934438B2 (en) 2021-06-28 2024-03-19 Rovi Guides, Inc. Subtitle rendering based on the reading pace
JPWO2023058451A1 (enExample) * 2021-10-04 2023-04-13
WO2023058393A1 (ja) * 2021-10-04 2023-04-13 ソニーグループ株式会社 情報処理装置、情報処理方法、及びプログラム
US12183121B2 (en) * 2021-12-22 2024-12-31 Tobii Ab Method for generating a video comprising blink data of a user viewing a scene
US12456466B2 (en) * 2023-01-26 2025-10-28 Meta Platforms Technologies, Llc Personalized and curated transcription of auditory experiences to improve user engagement
US12141353B1 (en) * 2023-07-07 2024-11-12 Toyota Motor Engineering & Manufacturing North America, Inc. Systems and methods for displaying dynamic closed-captioning content
US12346497B1 (en) * 2023-12-22 2025-07-01 Sony Interactive Entertainment Inc. Filtering of gaze tracking information to trigger reading control mode

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101385343A (zh) * 2006-02-13 2009-03-11 松下电器产业株式会社 显示数据生成设备
GB2467898A (en) * 2008-12-04 2010-08-18 Sharp Kk Display with automatic screen parameter adjustment based on the position of a detected viewer
CN102447863A (zh) * 2011-12-20 2012-05-09 四川长虹电器股份有限公司 一种多视点立体视频字幕处理方法
KR20120053803A (ko) * 2010-11-18 2012-05-29 삼성전자주식회사 시선 궤적을 이용한 컨텐츠 표시 장치 및 방법
GB2490868A (en) * 2011-05-09 2012-11-21 Nds Ltd A method of playing an audio track associated with a document in response to tracking the gaze of a user
WO2013118387A1 (ja) * 2012-02-10 2013-08-15 ソニー株式会社 情報処理装置、情報処理方法、及びプログラム
WO2013183206A1 (en) * 2012-06-07 2013-12-12 Sony Corporation Image processing apparatus, image processing method, and program
CN103475831A (zh) * 2012-06-06 2013-12-25 晨星软件研发(深圳)有限公司 应用于显示装置的字幕控制方法与元件

Family Cites Families (22)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5283560A (en) 1991-06-25 1994-02-01 Digital Equipment Corporation Computer system and method for displaying images with superimposed partially transparent menus
US5648789A (en) 1991-10-02 1997-07-15 National Captioning Institute, Inc. Method and apparatus for closed captioning at a performance
US5898423A (en) 1996-06-25 1999-04-27 Sun Microsystems, Inc. Method and apparatus for eyetrack-driven captioning
US6882354B1 (en) 1997-09-17 2005-04-19 Sun Microsystems, Inc. Scroll bars with user feedback
US7120880B1 (en) 1999-02-25 2006-10-10 International Business Machines Corporation Method and system for real-time determination of a subject's interest level to media content
US6886137B2 (en) 2001-05-29 2005-04-26 International Business Machines Corporation Eye gaze control of dynamic information presentation
US7284201B2 (en) 2001-09-20 2007-10-16 Koninklijke Philips Electronics N.V. User attention-based adaptation of quality level to improve the management of real-time multi-media content delivery and distribution
US8292433B2 (en) 2003-03-21 2012-10-23 Queen's University At Kingston Method and apparatus for communication between humans and devices
US7561143B1 (en) 2004-03-19 2009-07-14 The University of the Arts Using gaze actions to interact with a display
JP4686708B2 (ja) * 2005-02-28 2011-05-25 国立大学法人神戸大学 ポインティングシステム及びポインティング方法
JP5239469B2 (ja) 2008-04-07 2013-07-17 ソニー株式会社 情報提示装置及び情報提示方法
CN102077580B (zh) * 2009-04-30 2013-11-06 索尼公司 显示控制设备、显示控制方法
US20110084897A1 (en) * 2009-10-13 2011-04-14 Sony Ericsson Mobile Communications Ab Electronic device
JP5666219B2 (ja) * 2010-09-10 2015-02-12 ソフトバンクモバイル株式会社 眼鏡型表示装置及び翻訳システム
JP5348114B2 (ja) * 2010-11-18 2013-11-20 日本電気株式会社 情報表示システム、装置、方法及びプログラム
KR101919009B1 (ko) 2012-03-06 2018-11-16 삼성전자주식회사 안구 동작에 의한 제어 방법 및 이를 위한 디바이스
WO2013168173A1 (en) 2012-05-11 2013-11-14 Umoove Services Ltd. Gaze-based automatic scrolling
GB2504492A (en) 2012-07-30 2014-02-05 John Haddon Gaze detection and physical input for cursor symbol
US8854447B2 (en) * 2012-12-21 2014-10-07 United Video Properties, Inc. Systems and methods for automatically adjusting audio based on gaze point
US9256784B1 (en) * 2013-03-11 2016-02-09 Amazon Technologies, Inc. Eye event detection
US9848260B2 (en) * 2013-09-24 2017-12-19 Nuance Communications, Inc. Wearable communication enhancement device
US9568997B2 (en) * 2014-03-25 2017-02-14 Microsoft Technology Licensing, Llc Eye tracking enabled smart closed captioning

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101385343A (zh) * 2006-02-13 2009-03-11 松下电器产业株式会社 显示数据生成设备
GB2467898A (en) * 2008-12-04 2010-08-18 Sharp Kk Display with automatic screen parameter adjustment based on the position of a detected viewer
KR20120053803A (ko) * 2010-11-18 2012-05-29 삼성전자주식회사 시선 궤적을 이용한 컨텐츠 표시 장치 및 방법
GB2490868A (en) * 2011-05-09 2012-11-21 Nds Ltd A method of playing an audio track associated with a document in response to tracking the gaze of a user
CN102447863A (zh) * 2011-12-20 2012-05-09 四川长虹电器股份有限公司 一种多视点立体视频字幕处理方法
WO2013118387A1 (ja) * 2012-02-10 2013-08-15 ソニー株式会社 情報処理装置、情報処理方法、及びプログラム
CN103475831A (zh) * 2012-06-06 2013-12-25 晨星软件研发(深圳)有限公司 应用于显示装置的字幕控制方法与元件
WO2013183206A1 (en) * 2012-06-07 2013-12-12 Sony Corporation Image processing apparatus, image processing method, and program

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2024242677A1 (en) * 2023-05-24 2024-11-28 Carefusion 303, Inc. Device, system, and method for determining and increasing clinician engagement with infusion devices

Also Published As

Publication number Publication date
CA2939955A1 (en) 2015-10-01
US9568997B2 (en) 2017-02-14
EP3123280A1 (en) 2017-02-01
MX383736B (es) 2025-03-14
RU2016137950A (ru) 2018-03-27
JP6461989B2 (ja) 2019-01-30
RU2676045C2 (ru) 2018-12-25
KR20160138218A (ko) 2016-12-02
AU2015236456B2 (en) 2019-12-19
MX2016012200A (es) 2017-01-05
KR102513711B1 (ko) 2023-03-23
RU2016137950A3 (enExample) 2018-10-22
KR102411014B1 (ko) 2022-06-17
CA2939955C (en) 2022-05-17
US20150277552A1 (en) 2015-10-01
WO2015148276A1 (en) 2015-10-01
JP2017517045A (ja) 2017-06-22
US20170155868A1 (en) 2017-06-01
TW201539255A (zh) 2015-10-16
EP3123280B1 (en) 2019-01-02
AU2015236456A1 (en) 2016-09-08
US10447960B2 (en) 2019-10-15
CN106164819A (zh) 2016-11-23
KR20220084441A (ko) 2022-06-21

Similar Documents

Publication Publication Date Title
CN106164819B (zh) 眼睛跟踪使能智能隐藏字幕
JP6863488B2 (ja) 画像処理装置、異常検知方法、及びプログラム
CN105339868B (zh) 基于眼睛跟踪的视觉增强
TWI549505B (zh) 用於擴展現實顯示的基於理解力和意圖的內容
US20150302651A1 (en) System and method for augmented or virtual reality entertainment experience
KR102414602B1 (ko) 데이터 인식 모델 구축 장치 및 이의 데이터 인식 모델 구축 방법과, 데이터 인식 장치 및 이의 데이터 인식 방법
US20180011534A1 (en) Context-aware augmented reality object commands
RU2749000C2 (ru) Системы и способы для анимированной головы действующего лица
EP3327677A1 (en) An apparatus for spatial audio and associated method
JP2017516196A (ja) 会話検出
WO2013033842A1 (en) System and method for using eye gaze information to enhance interactions
JP7713517B2 (ja) 眼運動に基づくエクステンデッドリアリティ環境相互作用の方法およびシステム
US11392198B2 (en) Methods and systems of extended reality environment interaction based on eye motions
US10846535B2 (en) Virtual reality causal summary content
EP2690881A1 (en) Online video distribution
KR102262662B1 (ko) 동영상 학습 환경에서 학습자의 스캔 패턴에 기초한 학습 성과 예측 방법
Ringer et al. Creating a new dynamic measure of the useful field of view using gaze-contingent displays
US20240422396A1 (en) Automatic Media Control Based On Viewer Attention
WO2023120044A1 (ja) 表示装置、表示方法および表示プログラム
Dunn Which way is up? Grounded mental representations of space
JP2010063621A (ja) 視認情景に対する視認者感性反応装置
CN120631186A (zh) 提词文本的显示方法、装置、电子设备及计算机可读存储介质
CN119200849A (zh) 基于眼动轨迹分析的交互控制方法及其教学机
Richards Consciousness, attention, and peripheral experience

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20190326