JP5841538B2 - 関心度推定装置および関心度推定方法 - Google Patents
関心度推定装置および関心度推定方法 Download PDFInfo
- Publication number
- JP5841538B2 JP5841538B2 JP2012535534A JP2012535534A JP5841538B2 JP 5841538 B2 JP5841538 B2 JP 5841538B2 JP 2012535534 A JP2012535534 A JP 2012535534A JP 2012535534 A JP2012535534 A JP 2012535534A JP 5841538 B2 JP5841538 B2 JP 5841538B2
- Authority
- JP
- Japan
- Prior art keywords
- saliency
- interest
- area
- degree
- correlation
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims description 44
- 238000001514 detection method Methods 0.000 claims description 86
- 230000033001 locomotion Effects 0.000 claims description 64
- 230000004434 saccadic eye movement Effects 0.000 claims description 56
- 238000004458 analytical method Methods 0.000 claims description 48
- 238000006243 chemical reaction Methods 0.000 claims description 47
- 238000011156 evaluation Methods 0.000 claims description 37
- 230000008859 change Effects 0.000 claims description 19
- 230000003068 static effect Effects 0.000 claims description 19
- 230000002123 temporal effect Effects 0.000 claims description 19
- 238000004364 calculation method Methods 0.000 claims description 11
- 230000007423 decrease Effects 0.000 claims description 4
- 241001465754 Metazoa Species 0.000 claims description 3
- 238000004519 manufacturing process Methods 0.000 claims description 2
- 235000002673 Dioscorea communis Nutrition 0.000 description 40
- 241000544230 Dioscorea communis Species 0.000 description 40
- 208000035753 Periorbital contusion Diseases 0.000 description 40
- 238000010586 diagram Methods 0.000 description 35
- 238000012545 processing Methods 0.000 description 28
- 210000001508 eye Anatomy 0.000 description 18
- 230000004424 eye movement Effects 0.000 description 15
- 230000008569 process Effects 0.000 description 14
- 238000004590 computer program Methods 0.000 description 13
- 230000001815 facial effect Effects 0.000 description 12
- 230000000007 visual effect Effects 0.000 description 11
- 238000003384 imaging method Methods 0.000 description 10
- 210000005252 bulbus oculi Anatomy 0.000 description 7
- 239000000470 constituent Substances 0.000 description 7
- 230000004044 response Effects 0.000 description 7
- 238000012986 modification Methods 0.000 description 6
- 230000004048 modification Effects 0.000 description 6
- 230000006870 function Effects 0.000 description 5
- 210000001747 pupil Anatomy 0.000 description 5
- 238000005516 engineering process Methods 0.000 description 4
- 238000009434 installation Methods 0.000 description 4
- 230000010354 integration Effects 0.000 description 4
- 238000001028 reflection method Methods 0.000 description 4
- 230000007704 transition Effects 0.000 description 4
- 241000282412 Homo Species 0.000 description 3
- 210000004087 cornea Anatomy 0.000 description 3
- 238000009826 distribution Methods 0.000 description 3
- 210000001525 retina Anatomy 0.000 description 3
- 238000003860 storage Methods 0.000 description 3
- 208000003443 Unconsciousness Diseases 0.000 description 2
- 238000004891 communication Methods 0.000 description 2
- 238000010219 correlation analysis Methods 0.000 description 2
- 238000002570 electrooculography Methods 0.000 description 2
- 239000004065 semiconductor Substances 0.000 description 2
- 241000282414 Homo sapiens Species 0.000 description 1
- 241001479611 Iris ensata Species 0.000 description 1
- 230000006399 behavior Effects 0.000 description 1
- 230000008901 benefit Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 210000004556 brain Anatomy 0.000 description 1
- 238000005094 computer simulation Methods 0.000 description 1
- 238000007796 conventional method Methods 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 238000006073 displacement reaction Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000004880 explosion Methods 0.000 description 1
- 210000004709 eyebrow Anatomy 0.000 description 1
- 230000008921 facial expression Effects 0.000 description 1
- 238000005286 illumination Methods 0.000 description 1
- 230000010365 information processing Effects 0.000 description 1
- 239000000463 material Substances 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 230000035484 reaction time Effects 0.000 description 1
- 238000011160 research Methods 0.000 description 1
- 230000002441 reversible effect Effects 0.000 description 1
- 238000012552 review Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
- H04N21/258—Client or end-user data management, e.g. managing client capabilities, user preferences or demographics, processing of multiple end-users preferences to derive collaborative data
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N17/00—Diagnosis, testing or measuring for television systems or their details
- H04N17/04—Diagnosis, testing or measuring for television systems or their details for receivers
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
- H04N21/2343—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
- H04N21/23439—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements for generating different versions
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
- H04N21/258—Client or end-user data management, e.g. managing client capabilities, user preferences or demographics, processing of multiple end-users preferences to derive collaborative data
- H04N21/25866—Management of end-user data
- H04N21/25891—Management of end-user data being end-user preferences
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/41—Structure of client; Structure of client peripherals
- H04N21/422—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
- H04N21/4223—Cameras
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/44008—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/442—Monitoring of processes or resources, e.g. detecting the failure of a recording device, monitoring the downstream bandwidth, the number of times a movie has been viewed, the storage space available from the internal hard disk
- H04N21/44213—Monitoring of end-user related data
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Databases & Information Systems (AREA)
- Health & Medical Sciences (AREA)
- General Health & Medical Sciences (AREA)
- Computer Graphics (AREA)
- Social Psychology (AREA)
- Computer Networks & Wireless Communication (AREA)
- Biomedical Technology (AREA)
- Image Analysis (AREA)
- Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)
Description
図1は、本発明の実施の形態における関心度推定装置の機能構成を示すブロック図である。
まず、顕著性情報取得処理の詳細について説明する。ここでは、顕著性情報取得部102が、映像を解析することにより、顕著性情報を取得する場合について説明する。
次に、視線方向を検出する視線方向検出処理(S12)の詳細について説明する。
次に、上記のようにして検出された視線データ(注視座標系列)から視線運動を検出し、分類する方法について説明する。
次に、顕著性変動と注視反応の相関分析による関心度推定の詳細について説明する。
101 視線検出部
102 顕著性情報取得部
103 ユーザ反応分析部
Claims (19)
- 画面に表示された映像に対するユーザの関心度を推定する関心度推定装置であって、
前記ユーザの視線方向を検出する視線検出部と、
前記映像中の誘目性が顕著な領域である顕著領域に関する顕著性情報を取得する顕著性情報取得部と、
取得された前記顕著性情報から特定される顕著領域と検出された前記視線方向との相関を算出し、算出された前記相関が高いほど関心度が高くなるように、前記映像に対する前記ユーザの関心度を推定するユーザ反応分析部とを備え、
顕著領域の数および動きのうちの少なくとも一方に基づいて分類される複数の顕著パターンの各々には、相関の高さを評価するための少なくとも1つの評価基準があらかじめ対応付けられており、
前記ユーザ反応分析部は、前記顕著性情報から特定される顕著パターンに対応する評価基準に従って前記相関を算出する
関心度推定装置。 - 前記複数の顕著パターンは、顕著領域の位置が変化しない状態であることを示す静的パターンを含み、
前記静的パターンには、顕著領域内におけるサッケードの発生回数が前記少なくとも1つの評価基準として対応付けられており、
前記ユーザ反応分析部は、前記顕著性情報から特定される顕著パターンが静的パターンである場合に、検出された前記視線方向から特定される、前記顕著領域内におけるサッケードの発生回数が多いほど前記相関が高くなるように、前記相関を算出する
請求項1に記載の関心度推定装置。 - 前記顕著性情報取得部は、前記映像を示す信号に付与されたタグから前記顕著性情報を取得する
請求項1または2に記載の関心度推定装置。 - 前記顕著性情報取得部は、画像の物理的な特徴に基づいて前記映像を解析することにより前記顕著性情報を取得する
請求項1または2に記載の関心度推定装置。 - 前記顕著領域は、前記映像に付随した音声情報に関連するオブジェクトの領域である
請求項1〜4のいずれか1項に記載の関心度推定装置。 - 前記オブジェクトは、話者の顔または口である
請求項5に記載の関心度推定装置。 - 前記顕著領域は、前記音声情報に対応するテキストが表示される領域である
請求項5に記載の関心度推定装置。 - 前記顕著領域は、移動するオブジェクトの領域である
請求項1〜7のいずれか1項に記載の関心度推定装置。 - 前記オブジェクトは、人である
請求項8に記載の関心度推定装置。 - 前記オブジェクトは、動物である
請求項8に記載の関心度推定装置。 - 前記相関は、時間的な同期度である
請求項1〜10のいずれか1項に記載の関心度推定装置。 - 前記相関は、空間的な類似度である
請求項1〜11のいずれか1項に記載の関心度推定装置。 - 前記ユーザ反応分析部は、前記顕著領域の出現タイミングと、前記顕著領域に対する視線のサッケードの発生タイミングとの時間差を、前記相関の低さを表す値として算出し、
前記ユーザ反応分析部は、前記時間差が小さいほど関心度が高くなるように、前記関心度を推定する
請求項1〜12のいずれか1項に記載の関心度推定装置。 - 前記ユーザ反応分析部は、
前記顕著領域が所定の速度以上で前記画面上を移動するタイミングと、前記顕著領域に対する視線のサッケードの発生タイミングとの時間差を、前記相関の低さを表す値として算出し、
前記時間差が小さいほど関心度が高くなるように、前記関心度を推定する
請求項1〜13のいずれか1項に記載の関心度推定装置。 - 前記ユーザ反応分析部は、前記顕著領域の前記画面上の移動速度と、前記視線方向から特定される前記画面上の注視位置の移動速度との速度差を、前記相関の低さを表す値として算出し、
前記ユーザ反応分析部は、前記速度差が小さいほど関心度が高くなるように、前記関心度を推定する
請求項1〜14のいずれか1項に記載の関心度推定装置。 - 前記ユーザ反応分析部は、前記映像内の顕著領域の数、各顕著領域の面積、および視線のサッケードの発生回数に基づいて、前記相関を算出する
請求項1〜15のいずれか1項に記載の関心度推定装置。 - 前記関心度推定装置は、集積回路として構成されている
請求項1〜16のいずれか1項に記載の関心度推定装置。 - 画面に表示された映像に対するユーザの関心度を推定する関心度推定方法であって、
前記ユーザの視線方向を検出する視線検出ステップと、
前記映像中の誘目性が顕著な領域である顕著領域に関する顕著性情報を取得する顕著性情報取得ステップと、
取得された前記顕著性情報から特定される顕著領域と検出された前記視線方向との相関を算出する相関算出ステップと、
算出された前記相関が高いほど関心度が高くなるように、前記映像に対する前記ユーザの関心度を推定する関心度推定ステップとを含み、
顕著領域の数および動きのうちの少なくとも一方に基づいて分類される複数の顕著パターンの各々には、相関の高さを評価するための少なくとも1つの評価基準があらかじめ対応付けられており、
前記相関算出ステップでは、前記顕著性情報から特定される顕著パターンに対応する評価基準に従って前記相関を算出する
関心度推定方法。 - 請求項18に記載の関心度推定方法をコンピュータに実行させるためのプログラム。
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2012535534A JP5841538B2 (ja) | 2011-02-04 | 2012-01-26 | 関心度推定装置および関心度推定方法 |
Applications Claiming Priority (4)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2011023271 | 2011-02-04 | ||
JP2011023271 | 2011-02-04 | ||
JP2012535534A JP5841538B2 (ja) | 2011-02-04 | 2012-01-26 | 関心度推定装置および関心度推定方法 |
PCT/JP2012/000508 WO2012105196A1 (ja) | 2011-02-04 | 2012-01-26 | 関心度推定装置および関心度推定方法 |
Publications (2)
Publication Number | Publication Date |
---|---|
JPWO2012105196A1 JPWO2012105196A1 (ja) | 2014-07-03 |
JP5841538B2 true JP5841538B2 (ja) | 2016-01-13 |
Family
ID=46602422
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
JP2012535534A Active JP5841538B2 (ja) | 2011-02-04 | 2012-01-26 | 関心度推定装置および関心度推定方法 |
Country Status (4)
Country | Link |
---|---|
US (1) | US9538219B2 (ja) |
JP (1) | JP5841538B2 (ja) |
CN (1) | CN102934458B (ja) |
WO (1) | WO2012105196A1 (ja) |
Families Citing this family (88)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US9190110B2 (en) | 2009-05-12 | 2015-11-17 | JBF Interlude 2009 LTD | System and method for assembling a recorded composition |
US11232458B2 (en) | 2010-02-17 | 2022-01-25 | JBF Interlude 2009 LTD | System and method for data mining within interactive multimedia |
US9053562B1 (en) | 2010-06-24 | 2015-06-09 | Gregory S. Rabin | Two dimensional to three dimensional moving image converter |
US9538219B2 (en) * | 2011-02-04 | 2017-01-03 | Panasonic Intellectual Property Corporation Of America | Degree of interest estimating device and degree of interest estimating method |
JP6044234B2 (ja) * | 2012-09-28 | 2016-12-14 | 沖電気工業株式会社 | 画像処理装置及び画像処理方法 |
US11558672B1 (en) * | 2012-11-19 | 2023-01-17 | Cox Communications, Inc. | System for providing new content related to content currently being accessed |
KR101354248B1 (ko) * | 2012-12-14 | 2014-01-23 | 현대자동차주식회사 | 광고제품 정보 제공 시스템 및 방법 |
CA2902983A1 (en) * | 2013-03-06 | 2014-09-12 | Arthur J. Zito, Jr. | Multi-media presentation system |
US9881058B1 (en) | 2013-03-14 | 2018-01-30 | Google Inc. | Methods, systems, and media for displaying information related to displayed content upon detection of user attention |
EP2972678A4 (en) * | 2013-03-15 | 2016-11-02 | Interaxon Inc | CLOTHING COMPUTER APPARATUS AND ASSOCIATED METHOD |
JP6548203B2 (ja) * | 2013-03-18 | 2019-07-24 | 任天堂株式会社 | 情報処理プログラム、情報処理装置、情報処理システム、および、パノラマ動画表示方法 |
WO2015013685A1 (en) | 2013-07-25 | 2015-01-29 | Convida Wireless, Llc | End-to-end m2m service layer sessions |
CN103455580A (zh) * | 2013-08-26 | 2013-12-18 | 华为技术有限公司 | 一种推荐信息的方法和装置 |
US20160210276A1 (en) * | 2013-10-24 | 2016-07-21 | Sony Corporation | Information processing device, information processing method, and program |
US10165176B2 (en) * | 2013-10-31 | 2018-12-25 | The University Of North Carolina At Chapel Hill | Methods, systems, and computer readable media for leveraging user gaze in user monitoring subregion selection systems |
US9958939B2 (en) * | 2013-10-31 | 2018-05-01 | Sync-Think, Inc. | System and method for dynamic content delivery based on gaze analytics |
US9653115B2 (en) | 2014-04-10 | 2017-05-16 | JBF Interlude 2009 LTD | Systems and methods for creating linear video from branched video |
US9736503B1 (en) * | 2014-09-12 | 2017-08-15 | Google Inc. | Optimizing timing of display of a mid-roll video advertisement based on viewer retention data |
US9792957B2 (en) | 2014-10-08 | 2017-10-17 | JBF Interlude 2009 LTD | Systems and methods for dynamic video bookmarking |
US11412276B2 (en) | 2014-10-10 | 2022-08-09 | JBF Interlude 2009 LTD | Systems and methods for parallel track transitions |
WO2016118848A1 (en) * | 2015-01-22 | 2016-07-28 | Clearstream. Tv, Inc. | Video advertising system |
JP2016191845A (ja) * | 2015-03-31 | 2016-11-10 | ソニー株式会社 | 情報処理装置、情報処理方法及びプログラム |
CN104834896A (zh) * | 2015-04-03 | 2015-08-12 | 惠州Tcl移动通信有限公司 | 一种信息采集方法及其终端 |
US9916861B2 (en) | 2015-06-17 | 2018-03-13 | International Business Machines Corporation | Editing media on a mobile device before transmission |
JP6583996B2 (ja) * | 2015-07-17 | 2019-10-02 | 日本放送協会 | 映像評価装置、及びプログラム |
US10460765B2 (en) | 2015-08-26 | 2019-10-29 | JBF Interlude 2009 LTD | Systems and methods for adaptive and responsive video |
US11336928B1 (en) * | 2015-09-24 | 2022-05-17 | Amazon Technologies, Inc. | Predictive caching of identical starting sequences in content |
KR102147230B1 (ko) | 2015-12-16 | 2020-08-25 | 그레이스노트, 인코포레이티드 | 동적 비디오 오버레이 |
US11164548B2 (en) | 2015-12-22 | 2021-11-02 | JBF Interlude 2009 LTD | Intelligent buffering of large-scale video |
KR102102453B1 (ko) * | 2016-01-08 | 2020-04-20 | 주식회사 아이플래테아 | 시청률 산출 서버, 시청률 산출 방법, 및 시청률 산출 리모트 장치 |
JP6560137B2 (ja) * | 2016-02-08 | 2019-08-14 | Kddi株式会社 | 集中度の推定装置 |
US11856271B2 (en) | 2016-04-12 | 2023-12-26 | JBF Interlude 2009 LTD | Symbiotic interactive video |
WO2017196670A1 (en) | 2016-05-13 | 2017-11-16 | Vid Scale, Inc. | Bit depth remapping based on viewing parameters |
CN106101376B (zh) * | 2016-05-26 | 2021-01-05 | 努比亚技术有限公司 | 一种消息推送装置、方法及移动终端 |
WO2017205789A1 (en) * | 2016-05-27 | 2017-11-30 | Pelz Jeff B | System and method for eye tracking |
KR20170141453A (ko) * | 2016-06-15 | 2017-12-26 | 에스케이플래닛 주식회사 | 스크롤 패턴을 이용한 관심 정보 분석 방법 및 이를 이용한 장치 |
US11503314B2 (en) | 2016-07-08 | 2022-11-15 | Interdigital Madison Patent Holdings, Sas | Systems and methods for region-of-interest tone remapping |
CN106203372A (zh) * | 2016-07-19 | 2016-12-07 | 奇酷互联网络科技(深圳)有限公司 | 基于眼睛的活体检测方法、装置和终端设备 |
EP3488615A1 (en) * | 2016-07-22 | 2019-05-29 | VID SCALE, Inc. | Systems and methods for integrating and delivering objects of interest in video |
US20180310066A1 (en) * | 2016-08-09 | 2018-10-25 | Paronym Inc. | Moving image reproduction device, moving image reproduction method, moving image distribution system, storage medium with moving image reproduction program stored therein |
WO2018035133A1 (en) | 2016-08-17 | 2018-02-22 | Vid Scale, Inc. | Secondary content insertion in 360-degree video |
JP6996514B2 (ja) * | 2016-10-26 | 2022-01-17 | ソニーグループ株式会社 | 情報処理装置、情報処理システム、および情報処理方法、並びにプログラム |
WO2018097947A2 (en) | 2016-11-03 | 2018-05-31 | Convida Wireless, Llc | Reference signals and control channels in nr |
CN108124167A (zh) * | 2016-11-30 | 2018-06-05 | 阿里巴巴集团控股有限公司 | 一种播放处理方法、装置和设备 |
US11050809B2 (en) | 2016-12-30 | 2021-06-29 | JBF Interlude 2009 LTD | Systems and methods for dynamic weighting of branched video paths |
US10070154B2 (en) * | 2017-02-07 | 2018-09-04 | Fyusion, Inc. | Client-server communication for live filtering in a camera view |
EP3583780B1 (en) | 2017-02-17 | 2023-04-05 | InterDigital Madison Patent Holdings, SAS | Systems and methods for selective object-of-interest zooming in streaming video |
US11272237B2 (en) | 2017-03-07 | 2022-03-08 | Interdigital Madison Patent Holdings, Sas | Tailored video streaming for multi-device presentations |
US9832372B1 (en) * | 2017-03-18 | 2017-11-28 | Jerry L. Conway, Sr. | Dynamic vediotelphony systems and methods of using the same |
JP2019017800A (ja) | 2017-07-19 | 2019-02-07 | 富士通株式会社 | コンピュータプログラム、情報処理装置及び情報処理方法 |
US11328260B2 (en) * | 2017-07-19 | 2022-05-10 | Mitsubishi Electric Corporation | Behavior visualization device and behavior visualization method |
CN109276228B (zh) * | 2017-07-21 | 2020-12-25 | 成都集思鸣智科技有限公司 | 一种检测大脑功能的系统及其装置 |
JP6420876B1 (ja) * | 2017-07-26 | 2018-11-07 | 楽天株式会社 | 情報処理装置、情報処理システム、情報処理方法、及び情報処理プログラム |
US10496162B2 (en) * | 2017-07-26 | 2019-12-03 | Microsoft Technology Licensing, Llc | Controlling a computer using eyegaze and dwell |
CN107285148A (zh) * | 2017-08-07 | 2017-10-24 | 浙江新再灵科技股份有限公司 | 基于电梯场景的兴趣区域判断系统及方法 |
TWI642030B (zh) * | 2017-08-09 | 2018-11-21 | 宏碁股份有限公司 | 視覺效用分析方法及相關眼球追蹤裝置與系統 |
US10904615B2 (en) * | 2017-09-07 | 2021-01-26 | International Business Machines Corporation | Accessing and analyzing data to select an optimal line-of-sight and determine how media content is distributed and displayed |
CN107613289B (zh) * | 2017-10-19 | 2019-02-05 | 何翔 | 一种基于眨眼检测的视频内容分析方法及装置 |
WO2019087854A1 (ja) * | 2017-11-06 | 2019-05-09 | パナソニックIpマネジメント株式会社 | 片付け支援システム、片付け支援方法およびプログラム |
DE102018127756A1 (de) * | 2017-11-15 | 2019-05-16 | Omron Corporation | Fahrerüberwachungsvorrichtung, verfahren und programm |
JP6463826B1 (ja) * | 2017-11-27 | 2019-02-06 | 株式会社ドワンゴ | 動画配信サーバ、動画配信方法及び動画配信プログラム |
US10257578B1 (en) | 2018-01-05 | 2019-04-09 | JBF Interlude 2009 LTD | Dynamic library display for interactive videos |
US20190253751A1 (en) * | 2018-02-13 | 2019-08-15 | Perfect Corp. | Systems and Methods for Providing Product Information During a Live Broadcast |
US10382829B1 (en) * | 2018-03-23 | 2019-08-13 | Rovi Guides, Inc. | Systems and methods for prompting a user to view an important event in a media asset when the user is using another application |
US10440440B1 (en) | 2018-03-23 | 2019-10-08 | Rovi Guides, Inc. | Systems and methods for prompting a user to view an important event in a media asset presented on a first device when the user is viewing another media asset presented on a second device |
CN108563778B (zh) * | 2018-04-24 | 2022-11-04 | 北京市商汤科技开发有限公司 | 一种关注信息的处理方法及装置、存储介质、电子设备 |
US11507619B2 (en) | 2018-05-21 | 2022-11-22 | Hisense Visual Technology Co., Ltd. | Display apparatus with intelligent user interface |
US10965985B2 (en) | 2018-05-21 | 2021-03-30 | Hisense Visual Technology Co., Ltd. | Display apparatus with intelligent user interface |
US11601721B2 (en) * | 2018-06-04 | 2023-03-07 | JBF Interlude 2009 LTD | Interactive video dynamic adaptation and user profiling |
CN108737872A (zh) * | 2018-06-08 | 2018-11-02 | 百度在线网络技术(北京)有限公司 | 用于输出信息的方法和装置 |
WO2020068251A1 (en) | 2018-09-27 | 2020-04-02 | Convida Wireless, Llc | Sub-band operations in unlicensed spectrums of new radio |
US11416964B2 (en) * | 2018-10-26 | 2022-08-16 | Samsung Electronics Co., Ltd. | Method and device for adjusting resolution of HMD apparatus |
JP7263734B2 (ja) | 2018-10-29 | 2023-04-25 | 株式会社アイシン | 視認対象判定装置 |
CN111259702B (zh) * | 2018-12-03 | 2023-05-26 | 株式会社理光 | 一种用户兴趣的估计方法及装置 |
US20200288204A1 (en) * | 2019-03-05 | 2020-09-10 | Adobe Inc. | Generating and providing personalized digital content in real time based on live user context |
WO2020209491A1 (en) * | 2019-04-11 | 2020-10-15 | Samsung Electronics Co., Ltd. | Head-mounted display device and operating method of the same |
CN110248241B (zh) * | 2019-06-11 | 2021-06-04 | Oppo广东移动通信有限公司 | 视频处理方法及相关装置 |
US11490047B2 (en) | 2019-10-02 | 2022-11-01 | JBF Interlude 2009 LTD | Systems and methods for dynamically adjusting video aspect ratios |
JP6721169B1 (ja) * | 2019-11-14 | 2020-07-08 | 株式会社スワローインキュベート | 画像処理方法、画像処理装置、及び画像処理プログラム |
US10997625B1 (en) * | 2019-12-11 | 2021-05-04 | Cloudinary Ltd. | System, device, and method for determining predicted annoyance level of multimedia content |
JP7316664B2 (ja) * | 2020-02-03 | 2023-07-28 | マルコムホールディングス株式会社 | 対話ユーザの感情情報の提供装置 |
US11245961B2 (en) | 2020-02-18 | 2022-02-08 | JBF Interlude 2009 LTD | System and methods for detecting anomalous activities for interactive videos |
US11882337B2 (en) | 2021-05-28 | 2024-01-23 | JBF Interlude 2009 LTD | Automated platform for generating interactive videos |
US11934477B2 (en) | 2021-09-24 | 2024-03-19 | JBF Interlude 2009 LTD | Video player integration within websites |
US20230156300A1 (en) * | 2021-11-15 | 2023-05-18 | Comcast Cable Communications, Llc | Methods and systems for modifying content |
CN114298921A (zh) * | 2021-12-10 | 2022-04-08 | 苏州创捷传媒展览股份有限公司 | 一种基于客观内容驱动的评估观众视觉注意效果的方法 |
JP7481398B2 (ja) | 2022-07-04 | 2024-05-10 | ソフトバンク株式会社 | 判定装置、プログラム、及び判定方法 |
US11949967B1 (en) * | 2022-09-28 | 2024-04-02 | International Business Machines Corporation | Automatic connotation for audio and visual content using IOT sensors |
Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2006020131A (ja) * | 2004-07-02 | 2006-01-19 | Nippon Telegr & Teleph Corp <Ntt> | 関心度測定装置および関心度測定方法 |
WO2012105196A1 (ja) * | 2011-02-04 | 2012-08-09 | パナソニック株式会社 | 関心度推定装置および関心度推定方法 |
Family Cites Families (36)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US4789235A (en) * | 1986-04-04 | 1988-12-06 | Applied Science Group, Inc. | Method and system for generating a description of the distribution of looking time as people watch television commercials |
FR2683648B1 (fr) * | 1991-11-12 | 1996-12-13 | Apple Computer | Procede de choix d'objets dans une sequence d'images mobiles et piste d'essai de reussite correspondante. |
US5886683A (en) * | 1996-06-25 | 1999-03-23 | Sun Microsystems, Inc. | Method and apparatus for eyetrack-driven information retrieval |
US7120880B1 (en) | 1999-02-25 | 2006-10-10 | International Business Machines Corporation | Method and system for real-time determination of a subject's interest level to media content |
WO2001058160A1 (de) * | 2000-02-01 | 2001-08-09 | Swisscom Mobile Ag | System und verfahren zur verbreitung von bildobjekten |
US6873314B1 (en) * | 2000-08-29 | 2005-03-29 | International Business Machines Corporation | Method and system for the recognition of reading skimming and scanning from eye-gaze patterns |
GB2378340A (en) * | 2001-07-31 | 2003-02-05 | Hewlett Packard Co | Generation of an image bounded by a frame or of overlapping images |
US7274741B2 (en) * | 2002-11-01 | 2007-09-25 | Microsoft Corporation | Systems and methods for generating a comprehensive user attention model |
US7233684B2 (en) * | 2002-11-25 | 2007-06-19 | Eastman Kodak Company | Imaging method and system using affective information |
KR100763900B1 (ko) * | 2004-08-28 | 2007-10-05 | 삼성전자주식회사 | 사용자 시선정보에 기반한 텔레비전 프로그램 녹화/재생방법 및 그 장치 |
US7690011B2 (en) * | 2005-05-02 | 2010-03-30 | Technology, Patents & Licensing, Inc. | Video stream modification to defeat detection |
US7595809B2 (en) * | 2005-05-11 | 2009-09-29 | Hewlett-Packard Development Company, L.P. | Method and system for determining an occlusion cost for concurrently presenting one or more images in a shared viewing region |
US7773813B2 (en) * | 2005-10-31 | 2010-08-10 | Microsoft Corporation | Capture-intention detection for video content analysis |
WO2007056373A2 (en) * | 2005-11-04 | 2007-05-18 | Eyetracking, Inc. | Characterizing dynamic regions of digital media data |
US20070157260A1 (en) * | 2005-12-29 | 2007-07-05 | United Video Properties, Inc. | Interactive media guidance system having multiple devices |
US8446509B2 (en) * | 2006-08-09 | 2013-05-21 | Tenebraex Corporation | Methods of creating a virtual window |
US8295683B2 (en) * | 2007-04-23 | 2012-10-23 | Hewlett-Packard Development Company, L.P. | Temporal occlusion costing applied to video editing |
US20090003712A1 (en) * | 2007-06-28 | 2009-01-01 | Microsoft Corporation | Video Collage Presentation |
JP5089470B2 (ja) | 2008-04-09 | 2012-12-05 | 本田技研工業株式会社 | 関心度推定装置および方法 |
US8079054B1 (en) * | 2008-04-14 | 2011-12-13 | Adobe Systems Incorporated | Location for secondary content based on data differential |
CA2651464C (en) * | 2008-04-30 | 2017-10-24 | Crim (Centre De Recherche Informatique De Montreal) | Method and apparatus for caption production |
JP5413002B2 (ja) * | 2008-09-08 | 2014-02-12 | ソニー株式会社 | 撮像装置および方法、並びにプログラム |
JP5224149B2 (ja) * | 2008-09-08 | 2013-07-03 | ソニー株式会社 | 画像処理装置および方法、撮像装置、並びにプログラム |
KR101596975B1 (ko) * | 2008-12-16 | 2016-02-23 | 파나소닉 인텔렉츄얼 프로퍼티 코포레이션 오브 아메리카 | 정보 표시 장치 및 정보 표시 방법 |
KR101644421B1 (ko) * | 2008-12-23 | 2016-08-03 | 삼성전자주식회사 | 사용자의 관심 정도에 기반한 컨텐츠 제공장치 및 방법 |
JP4775671B2 (ja) * | 2008-12-26 | 2011-09-21 | ソニー株式会社 | 情報処理装置および方法、並びにプログラム |
US8808195B2 (en) * | 2009-01-15 | 2014-08-19 | Po-He Tseng | Eye-tracking method and system for screening human diseases |
US8464288B2 (en) * | 2009-01-21 | 2013-06-11 | The Nielsen Company (Us), Llc | Methods and apparatus for providing personalized media in video |
US8539359B2 (en) * | 2009-02-11 | 2013-09-17 | Jeffrey A. Rapaport | Social network driven indexing system for instantly clustering people with concurrent focus on same topic into on-topic chat rooms and/or for generating on-topic search results tailored to user preferences regarding topic |
US8175376B2 (en) * | 2009-03-09 | 2012-05-08 | Xerox Corporation | Framework for image thumbnailing based on visual similarity |
US8332255B2 (en) * | 2009-11-09 | 2012-12-11 | Palo Alto Research Center Incorporated | Sensor-integrated mirror for determining consumer shopping behavior |
US8830164B2 (en) * | 2009-12-14 | 2014-09-09 | Panasonic Intellectual Property Corporation Of America | User interface device and input method |
US8487959B1 (en) * | 2010-08-06 | 2013-07-16 | Google Inc. | Generating simulated eye movement traces for visual displays |
US9213405B2 (en) * | 2010-12-16 | 2015-12-15 | Microsoft Technology Licensing, Llc | Comprehension and intent-based content for augmented reality displays |
AU2011204946C1 (en) * | 2011-07-22 | 2012-07-26 | Microsoft Technology Licensing, Llc | Automatic text scrolling on a head-mounted display |
US9442565B2 (en) * | 2011-08-24 | 2016-09-13 | The United States Of America, As Represented By The Secretary Of The Navy | System and method for determining distracting features in a visual display |
-
2012
- 2012-01-26 US US13/701,540 patent/US9538219B2/en active Active
- 2012-01-26 WO PCT/JP2012/000508 patent/WO2012105196A1/ja active Application Filing
- 2012-01-26 JP JP2012535534A patent/JP5841538B2/ja active Active
- 2012-01-26 CN CN201280001532.6A patent/CN102934458B/zh active Active
Patent Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2006020131A (ja) * | 2004-07-02 | 2006-01-19 | Nippon Telegr & Teleph Corp <Ntt> | 関心度測定装置および関心度測定方法 |
WO2012105196A1 (ja) * | 2011-02-04 | 2012-08-09 | パナソニック株式会社 | 関心度推定装置および関心度推定方法 |
Also Published As
Publication number | Publication date |
---|---|
JPWO2012105196A1 (ja) | 2014-07-03 |
WO2012105196A1 (ja) | 2012-08-09 |
CN102934458A (zh) | 2013-02-13 |
CN102934458B (zh) | 2016-06-29 |
US9538219B2 (en) | 2017-01-03 |
US20130091515A1 (en) | 2013-04-11 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
JP5841538B2 (ja) | 関心度推定装置および関心度推定方法 | |
US10517521B2 (en) | Mental state mood analysis using heart rate collection based on video imagery | |
JP5602155B2 (ja) | ユーザインタフェース装置および入力方法 | |
JP7229174B2 (ja) | 人識別システム及び方法 | |
Coutrot et al. | Face exploration dynamics differentiate men and women | |
JP5460691B2 (ja) | 注視対象判定装置及び注視対象判定方法 | |
Dorr et al. | Variability of eye movements when viewing dynamic natural scenes | |
JP4622702B2 (ja) | 映像監視装置 | |
US20160191995A1 (en) | Image analysis for attendance query evaluation | |
US20170011258A1 (en) | Image analysis in support of robotic manipulation | |
WO2013018267A1 (ja) | 提示制御装置、及び提示制御方法 | |
US20150313530A1 (en) | Mental state event definition generation | |
US20120243751A1 (en) | Baseline face analysis | |
Ghosh et al. | Real time eye detection and tracking method for driver assistance system | |
JP2016521411A (ja) | 頭部及び眼球追跡 | |
JP5225870B2 (ja) | 情動分析装置 | |
US20170105668A1 (en) | Image analysis for data collected from a remote computing device | |
Larsson et al. | Head movement compensation and multi-modal event detection in eye-tracking data for unconstrained head movements | |
JP2017522104A (ja) | 目状態決定システム | |
JP2013202273A (ja) | 眠気レベルの推定装置、眠気レベルの推定方法および眠気レベルの推定処理プログラム | |
Heinrich et al. | Video based actigraphy and breathing monitoring from the bedside table of shared beds | |
JP2016111612A (ja) | コンテンツ表示装置 | |
KR101877873B1 (ko) | 공포 심리 분석 시스템 및 방법 | |
KR102327578B1 (ko) | 웨어러블 디바이스를 이용한 객체 및 상황 정보 제공장치 및 방법 | |
Manousos et al. | Contactless detection of facial signs related to stress: A preliminary study |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
A711 | Notification of change in applicant |
Free format text: JAPANESE INTERMEDIATE CODE: A711 Effective date: 20140606 |
|
A621 | Written request for application examination |
Free format text: JAPANESE INTERMEDIATE CODE: A621 Effective date: 20140825 |
|
TRDD | Decision of grant or rejection written | ||
A01 | Written decision to grant a patent or to grant a registration (utility model) |
Free format text: JAPANESE INTERMEDIATE CODE: A01 Effective date: 20151104 |
|
A61 | First payment of annual fees (during grant procedure) |
Free format text: JAPANESE INTERMEDIATE CODE: A61 Effective date: 20151113 |
|
R150 | Certificate of patent or registration of utility model |
Ref document number: 5841538 Country of ref document: JP Free format text: JAPANESE INTERMEDIATE CODE: R150 |