KR102513711B1 - 눈 추적 지원 스마트 클로즈드 캡션 - Google Patents

눈 추적 지원 스마트 클로즈드 캡션 Download PDF

Info

Publication number
KR102513711B1
KR102513711B1 KR1020227019887A KR20227019887A KR102513711B1 KR 102513711 B1 KR102513711 B1 KR 102513711B1 KR 1020227019887 A KR1020227019887 A KR 1020227019887A KR 20227019887 A KR20227019887 A KR 20227019887A KR 102513711 B1 KR102513711 B1 KR 102513711B1
Authority
KR
South Korea
Prior art keywords
closed caption
gaze
user
caption
predetermined
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
KR1020227019887A
Other languages
English (en)
Korean (ko)
Other versions
KR20220084441A (ko
Inventor
위라판 위라이랏
바이브하브 투크랄
Original Assignee
마이크로소프트 테크놀로지 라이센싱, 엘엘씨
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 마이크로소프트 테크놀로지 라이센싱, 엘엘씨 filed Critical 마이크로소프트 테크놀로지 라이센싱, 엘엘씨
Publication of KR20220084441A publication Critical patent/KR20220084441A/ko
Application granted granted Critical
Publication of KR102513711B1 publication Critical patent/KR102513711B1/ko
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/488—Data services, e.g. news ticker
    • H04N21/4884—Data services, e.g. news ticker for displaying subtitles
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/013—Eye tracking input arrangements
    • G—PHYSICS
    • G11—INFORMATION STORAGE
    • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B27/00—Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
    • G11B27/10—Indexing; Addressing; Timing or synchronising; Measuring tape travel
    • G11B27/19—Indexing; Addressing; Timing or synchronising; Measuring tape travel by using information detectable on the record carrier
    • G11B27/28—Indexing; Addressing; Timing or synchronising; Measuring tape travel by using information detectable on the record carrier by using information signals recorded by the same method as the main recording
    • G—PHYSICS
    • G11—INFORMATION STORAGE
    • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B27/00—Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
    • G11B27/10—Indexing; Addressing; Timing or synchronising; Measuring tape travel
    • G11B27/34—Indicating arrangements 
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/422—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
    • H04N21/4223—Cameras
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/442—Monitoring of processes or resources, e.g. detecting the failure of a recording device, monitoring the downstream bandwidth, the number of times a movie has been viewed, the storage space available from the internal hard disk
    • H04N21/44213—Monitoring of end-user related data
    • H04N21/44218—Detecting physical presence or behaviour of the user, e.g. using sensors to detect if the user is leaving the room or changes his face expression during a TV programme
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/76—Television signal recording
    • H04N5/84—Television signal recording using optical recording
    • H04N5/85—Television signal recording using optical recording on discs or drums
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
    • G06F2203/048—Indexing scheme relating to G06F3/048
    • G06F2203/04804—Transparency, e.g. transparent or translucent windows

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Social Psychology (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Databases & Information Systems (AREA)
  • User Interface Of Digital Computer (AREA)
  • Controls And Circuits For Display Device (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
  • Position Input By Displaying (AREA)
  • Control Of Indicators Other Than Cathode Ray Tubes (AREA)
KR1020227019887A 2014-03-25 2015-03-20 눈 추적 지원 스마트 클로즈드 캡션 Active KR102513711B1 (ko)

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
US14/225,181 US9568997B2 (en) 2014-03-25 2014-03-25 Eye tracking enabled smart closed captioning
US14/225,181 2014-03-25
KR1020167029821A KR102411014B1 (ko) 2014-03-25 2015-03-20 눈 추적 지원 스마트 클로즈드 캡션
PCT/US2015/021619 WO2015148276A1 (en) 2014-03-25 2015-03-20 Eye tracking enabled smart closed captioning

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
KR1020167029821A Division KR102411014B1 (ko) 2014-03-25 2015-03-20 눈 추적 지원 스마트 클로즈드 캡션

Publications (2)

Publication Number Publication Date
KR20220084441A KR20220084441A (ko) 2022-06-21
KR102513711B1 true KR102513711B1 (ko) 2023-03-23

Family

ID=52814232

Family Applications (2)

Application Number Title Priority Date Filing Date
KR1020227019887A Active KR102513711B1 (ko) 2014-03-25 2015-03-20 눈 추적 지원 스마트 클로즈드 캡션
KR1020167029821A Active KR102411014B1 (ko) 2014-03-25 2015-03-20 눈 추적 지원 스마트 클로즈드 캡션

Family Applications After (1)

Application Number Title Priority Date Filing Date
KR1020167029821A Active KR102411014B1 (ko) 2014-03-25 2015-03-20 눈 추적 지원 스마트 클로즈드 캡션

Country Status (11)

Country Link
US (2) US9568997B2 (enExample)
EP (1) EP3123280B1 (enExample)
JP (1) JP6461989B2 (enExample)
KR (2) KR102513711B1 (enExample)
CN (1) CN106164819B (enExample)
AU (1) AU2015236456B2 (enExample)
CA (1) CA2939955C (enExample)
MX (1) MX383736B (enExample)
RU (1) RU2676045C2 (enExample)
TW (1) TW201539255A (enExample)
WO (1) WO2015148276A1 (enExample)

Families Citing this family (36)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9875218B2 (en) * 2014-01-28 2018-01-23 International Business Machines Corporation Document summarization
US9568997B2 (en) * 2014-03-25 2017-02-14 Microsoft Technology Licensing, Llc Eye tracking enabled smart closed captioning
KR20170041720A (ko) * 2014-08-07 2017-04-17 포브, 아이엔씨. 3차원상의 주시점의 위치 특정 알고리즘
US10317994B2 (en) * 2015-06-05 2019-06-11 International Business Machines Corporation Initiating actions responsive to user expressions of a user while reading media content
RU2718121C2 (ru) * 2015-06-30 2020-03-30 Сони Корпорейшн Приемное устройство, способ приема, передающее устройство и способ передачи
CN107852521B (zh) * 2015-08-07 2023-04-11 苹果公司 用于显示图像流的系统和方法
JP6404196B2 (ja) 2015-09-16 2018-10-10 グリー株式会社 仮想画像表示プログラム、仮想画像表示装置及び仮想画像表示方法
US10444972B2 (en) 2015-11-28 2019-10-15 International Business Machines Corporation Assisting a user with efficient navigation between a selection of entries with elements of interest to the user within a stream of entries
CN106993227B (zh) * 2016-01-20 2020-01-21 腾讯科技（北京）有限公司 一种进行信息展示的方法和装置
US20170293363A1 (en) * 2016-04-07 2017-10-12 Jeffrey Shawn McLaughlin System And Methods For Eye Gaze Triggered Control Of Appliance By Hand Gesture
CA3046329A1 (en) 2016-12-06 2018-06-14 Donn M. GURULE Systems and methods for a chronological-based search engine
JP6831228B2 (ja) * 2016-12-15 2021-02-17 株式会社Ｚ会 情報処理装置、情報処理システム及び情報処理方法
US20180302686A1 (en) * 2017-04-14 2018-10-18 International Business Machines Corporation Personalizing closed captions for video content
US10425696B2 (en) 2017-07-11 2019-09-24 Sony Corporation User placement of closed captioning
CN116185168A (zh) * 2018-07-26 2023-05-30 中兴通讯股份有限公司 一种调整多媒体信息的输出参数的方法、终端和存储介质
CN109271027B (zh) * 2018-09-17 2022-10-14 北京旷视科技有限公司 页面控制方法、装置及电子设备
JP7153522B2 (ja) * 2018-10-11 2022-10-14 日本放送協会 字幕表示装置及びそのプログラム
KR102659863B1 (ko) 2018-11-28 2024-04-24 삼성전자주식회사 전자 장치 및 그 제어 방법
US10880515B2 (en) * 2018-12-14 2020-12-29 Sony Corporation Audio-video reproduction for closed caption display control based on multi-media content
US11069368B2 (en) * 2018-12-18 2021-07-20 Colquitt Partners, Ltd. Glasses with closed captioning, voice recognition, volume of speech detection, and translation capabilities
US11087778B2 (en) * 2019-02-15 2021-08-10 Qualcomm Incorporated Speech-to-text conversion based on quality metric
CN110248241B (zh) * 2019-06-11 2021-06-04 Oppo广东移动通信有限公司 视频处理方法及相关装置
JP7346135B2 (ja) * 2019-07-30 2023-09-19 キヤノン株式会社 電子機器、電子機器の制御方法、プログラムおよび記憶媒体
CN112584280B (zh) * 2019-09-27 2022-11-29 百度在线网络技术（北京）有限公司 智能设备的控制方法、装置、设备和介质
US11070891B1 (en) * 2019-12-10 2021-07-20 Amazon Technologies, Inc. Optimization of subtitles for video content
CN113672132A (zh) * 2020-05-13 2021-11-19 聚好看科技股份有限公司 一种文本框控件显示位置的调整方法及显示设备
TWI755037B (zh) * 2020-08-21 2022-02-11 陳筱涵 影音錄製裝置與影音編輯播放系統
US12210553B2 (en) * 2021-06-28 2025-01-28 Adeia Guides Inc. Subtitle rendering based on the reading pace
US11934438B2 (en) 2021-06-28 2024-03-19 Rovi Guides, Inc. Subtitle rendering based on the reading pace
JPWO2023058451A1 (enExample) * 2021-10-04 2023-04-13
WO2023058393A1 (ja) * 2021-10-04 2023-04-13 ソニーグループ株式会社 情報処理装置、情報処理方法、及びプログラム
US12183121B2 (en) * 2021-12-22 2024-12-31 Tobii Ab Method for generating a video comprising blink data of a user viewing a scene
US12456466B2 (en) * 2023-01-26 2025-10-28 Meta Platforms Technologies, Llc Personalized and curated transcription of auditory experiences to improve user engagement
CN121285860A (zh) * 2023-05-24 2026-01-06 康尔福盛303公司 用于确定并提高临床医生对输注设备的参与度的设备、系统和方法
US12141353B1 (en) * 2023-07-07 2024-11-12 Toyota Motor Engineering & Manufacturing North America, Inc. Systems and methods for displaying dynamic closed-captioning content
US12346497B1 (en) * 2023-12-22 2025-07-01 Sony Interactive Entertainment Inc. Filtering of gaze tracking information to trigger reading control mode

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2009253689A (ja) 2008-04-07 2009-10-29 Sony Corp 情報提示装置及び情報提示方法
WO2013183206A1 (en) 2012-06-07 2013-12-12 Sony Corporation Image processing apparatus, image processing method, and program

Family Cites Families (28)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5283560A (en) 1991-06-25 1994-02-01 Digital Equipment Corporation Computer system and method for displaying images with superimposed partially transparent menus
US5648789A (en) 1991-10-02 1997-07-15 National Captioning Institute, Inc. Method and apparatus for closed captioning at a performance
US5898423A (en) 1996-06-25 1999-04-27 Sun Microsystems, Inc. Method and apparatus for eyetrack-driven captioning
US6882354B1 (en) 1997-09-17 2005-04-19 Sun Microsystems, Inc. Scroll bars with user feedback
US7120880B1 (en) 1999-02-25 2006-10-10 International Business Machines Corporation Method and system for real-time determination of a subject's interest level to media content
US6886137B2 (en) 2001-05-29 2005-04-26 International Business Machines Corporation Eye gaze control of dynamic information presentation
US7284201B2 (en) 2001-09-20 2007-10-16 Koninklijke Philips Electronics N.V. User attention-based adaptation of quality level to improve the management of real-time multi-media content delivery and distribution
US8292433B2 (en) 2003-03-21 2012-10-23 Queen's University At Kingston Method and apparatus for communication between humans and devices
US7561143B1 (en) 2004-03-19 2009-07-14 The University of the Arts Using gaze actions to interact with a display
JP4686708B2 (ja) * 2005-02-28 2011-05-25 国立大学法人神戸大学 ポインティングシステム及びポインティング方法
JP2007215097A (ja) * 2006-02-13 2007-08-23 Matsushita Electric Ind Co Ltd 表示データ生成装置
GB2467898A (en) 2008-12-04 2010-08-18 Sharp Kk Display with automatic screen parameter adjustment based on the position of a detected viewer
CN102077580B (zh) * 2009-04-30 2013-11-06 索尼公司 显示控制设备、显示控制方法
US20110084897A1 (en) * 2009-10-13 2011-04-14 Sony Ericsson Mobile Communications Ab Electronic device
JP5666219B2 (ja) * 2010-09-10 2015-02-12 ソフトバンクモバイル株式会社 眼鏡型表示装置及び翻訳システム
JP5348114B2 (ja) * 2010-11-18 2013-11-20 日本電気株式会社 情報表示システム、装置、方法及びプログラム
KR20120053803A (ko) 2010-11-18 2012-05-29 삼성전자주식회사 시선 궤적을 이용한 컨텐츠 표시 장치 및 방법
GB2490868A (en) 2011-05-09 2012-11-21 Nds Ltd A method of playing an audio track associated with a document in response to tracking the gaze of a user
CN102447863A (zh) * 2011-12-20 2012-05-09 四川长虹电器股份有限公司 一种多视点立体视频字幕处理方法
CN104081784B (zh) 2012-02-10 2017-12-08 索尼公司 信息处理装置、信息处理方法和程序
KR101919009B1 (ko) 2012-03-06 2018-11-16 삼성전자주식회사 안구 동작에 의한 제어 방법 및 이를 위한 디바이스
WO2013168173A1 (en) 2012-05-11 2013-11-14 Umoove Services Ltd. Gaze-based automatic scrolling
CN103475831A (zh) * 2012-06-06 2013-12-25 晨星软件研发(深圳)有限公司 应用于显示装置的字幕控制方法与元件
GB2504492A (en) 2012-07-30 2014-02-05 John Haddon Gaze detection and physical input for cursor symbol
US8854447B2 (en) * 2012-12-21 2014-10-07 United Video Properties, Inc. Systems and methods for automatically adjusting audio based on gaze point
US9256784B1 (en) * 2013-03-11 2016-02-09 Amazon Technologies, Inc. Eye event detection
US9848260B2 (en) * 2013-09-24 2017-12-19 Nuance Communications, Inc. Wearable communication enhancement device
US9568997B2 (en) * 2014-03-25 2017-02-14 Microsoft Technology Licensing, Llc Eye tracking enabled smart closed captioning

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2009253689A (ja) 2008-04-07 2009-10-29 Sony Corp 情報提示装置及び情報提示方法
WO2013183206A1 (en) 2012-06-07 2013-12-12 Sony Corporation Image processing apparatus, image processing method, and program

Also Published As

Publication number Publication date
CA2939955A1 (en) 2015-10-01
US9568997B2 (en) 2017-02-14
EP3123280A1 (en) 2017-02-01
MX383736B (es) 2025-03-14
RU2016137950A (ru) 2018-03-27
JP6461989B2 (ja) 2019-01-30
RU2676045C2 (ru) 2018-12-25
KR20160138218A (ko) 2016-12-02
AU2015236456B2 (en) 2019-12-19
MX2016012200A (es) 2017-01-05
RU2016137950A3 (enExample) 2018-10-22
KR102411014B1 (ko) 2022-06-17
CA2939955C (en) 2022-05-17
US20150277552A1 (en) 2015-10-01
WO2015148276A1 (en) 2015-10-01
JP2017517045A (ja) 2017-06-22
US20170155868A1 (en) 2017-06-01
TW201539255A (zh) 2015-10-16
EP3123280B1 (en) 2019-01-02
AU2015236456A1 (en) 2016-09-08
US10447960B2 (en) 2019-10-15
CN106164819A (zh) 2016-11-23
CN106164819B (zh) 2019-03-26
KR20220084441A (ko) 2022-06-21

Similar Documents

Publication Publication Date Title
KR102513711B1 (ko) 눈 추적 지원 스마트 클로즈드 캡션
US10705602B2 (en) Context-aware augmented reality object commands
US11630509B2 (en) Determining user intent based on attention values
KR102223696B1 (ko) 위치 신호를 통한 사용자 인터페이스 요소들의 선택
KR102357633B1 (ko) 대화 감지
US9721587B2 (en) Visual feedback for speech recognition system
US20190394419A1 (en) Subtitle displaying method and apparatus
US20180181197A1 (en) Input Determination Method
US20150302869A1 (en) Conversation, presence and context detection for hologram suppression
KR20160135242A (ko) 시선 검출을 통한 원격 디바이스 제어
JPWO2018155026A1 (ja) 情報処理装置、情報処理方法、及びプログラム
KR20160109443A (ko) 시선 추적을 이용한 디스플레이 장치 및 방법

Legal Events

Date Code Title Description
A107 Divisional application of patent
PA0104 Divisional application for international application

Comment text: Divisional Application for International Patent

Patent event code: PA01041R01D

Patent event date: 20220613

Application number text: 1020167029821

Filing date: 20161025

PA0201 Request for examination
PG1501 Laying open of application
E902 Notification of reason for refusal
PE0902 Notice of grounds for rejection

Comment text: Notification of reason for refusal

Patent event date: 20220629

Patent event code: PE09021S01D

E701 Decision to grant or registration of patent right
PE0701 Decision of registration

Patent event code: PE07011S01D

Comment text: Decision to Grant Registration

Patent event date: 20221223

GRNT Written decision to grant
PR0701 Registration of establishment

Comment text: Registration of Establishment

Patent event date: 20230321

Patent event code: PR07011E01D

PR1002 Payment of registration fee

Payment date: 20230321

End annual number: 3

Start annual number: 1

PG1601 Publication of registration