KR102164723B1 - 3-d 플레놉틱 비디오 이미지들을 생성하는 시스템 및 방법 - Google Patents

3-d 플레놉틱 비디오 이미지들을 생성하는 시스템 및 방법 Download PDF

Info

Publication number
KR102164723B1
KR102164723B1 KR1020157016975A KR20157016975A KR102164723B1 KR 102164723 B1 KR102164723 B1 KR 102164723B1 KR 1020157016975 A KR1020157016975 A KR 1020157016975A KR 20157016975 A KR20157016975 A KR 20157016975A KR 102164723 B1 KR102164723 B1 KR 102164723B1
Authority
KR
South Korea
Prior art keywords
user
plenoptic
image
eye tracking
gaze
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
KR1020157016975A
Other languages
English (en)
Korean (ko)
Other versions
KR20150090183A (ko
Inventor
줄리아노 마치오치
Original Assignee
퀄컴 인코포레이티드
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 퀄컴 인코포레이티드 filed Critical 퀄컴 인코포레이티드
Publication of KR20150090183A publication Critical patent/KR20150090183A/ko
Application granted granted Critical
Publication of KR102164723B1 publication Critical patent/KR102164723B1/ko
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30—Image reproducers
    • H04N13/366—Image reproducers using viewer tracking
    • H04N13/383—Image reproducers using viewer tracking for tracking with gaze detection, i.e. detecting the lines of sight of the viewer's eyes
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/013—Eye tracking input arrangements
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00—Image enhancement or restoration
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/204—Image signal generators using stereoscopic image cameras
    • H04N13/207—Image signal generators using stereoscopic image cameras using a single 2D image sensor
    • H04N13/232—Image signal generators using stereoscopic image cameras using a single 2D image sensor using fly-eye lenses, e.g. arrangements of circular lenses

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)
  • Studio Devices (AREA)
  • Processing Or Creating Images (AREA)
  • Image Processing (AREA)
KR1020157016975A 2012-11-27 2013-11-13 3-d 플레놉틱 비디오 이미지들을 생성하는 시스템 및 방법 Active KR102164723B1 (ko)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US13/686,456 2012-11-27
US13/686,456 US9137524B2 (en) 2012-11-27 2012-11-27 System and method for generating 3-D plenoptic video images
PCT/US2013/069875 WO2014085092A1 (en) 2012-11-27 2013-11-13 System and method for generating 3-d plenoptic video images

Publications (2)

Publication Number Publication Date
KR20150090183A KR20150090183A (ko) 2015-08-05
KR102164723B1 true KR102164723B1 (ko) 2020-10-13

Family

ID=49641897

Family Applications (1)

Application Number Title Priority Date Filing Date
KR1020157016975A Active KR102164723B1 (ko) 2012-11-27 2013-11-13 3-d 플레놉틱 비디오 이미지들을 생성하는 시스템 및 방법

Country Status (6)

Country Link
US (1) US9137524B2 (enExample)
EP (1) EP2926554A1 (enExample)
JP (2) JP2016504825A (enExample)
KR (1) KR102164723B1 (enExample)
CN (1) CN104798370B (enExample)
WO (1) WO2014085092A1 (enExample)

Families Citing this family (31)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TW201426018A (zh) * 2012-12-19 2014-07-01 Ind Tech Res Inst 影像處理裝置及影像再對焦方法
US9699433B2 (en) * 2013-01-24 2017-07-04 Yuchen Zhou Method and apparatus to produce re-focusable vision with detecting re-focusing event from human eye
US20140327771A1 (en) * 2013-05-01 2014-11-06 Nvidia Corporation System, method, and computer program product for displaying a scene as a light field
US9319665B2 (en) * 2013-06-19 2016-04-19 TrackThings LLC Method and apparatus for a self-focusing camera and eyeglass system
US20140375772A1 (en) * 2013-06-19 2014-12-25 Thaddeus Gabara Method and Apparatus for an SR and LR 3-D Visual Images and Sharing
US11343487B2 (en) 2013-10-31 2022-05-24 David Woods Trackable glasses system for perspective views of a display
US9986228B2 (en) 2016-03-24 2018-05-29 3Di Llc Trackable glasses system that provides multiple views of a shared display
US10652525B2 (en) 2013-10-31 2020-05-12 3Di Llc Quad view display system
US10091411B2 (en) * 2014-06-17 2018-10-02 Lg Electronics Inc. Mobile terminal and controlling method thereof for continuously tracking object included in video
CN105323573B (zh) * 2014-07-16 2019-02-05 北京三星通信技术研究有限公司 三维图像显示装置和方法
CN104539924A (zh) * 2014-12-03 2015-04-22 深圳市亿思达科技集团有限公司 基于人眼追踪的全息显示方法及全息显示装置
US9541998B2 (en) * 2015-01-29 2017-01-10 Samsung Electronics Co., Ltd. Electronic system with gaze alignment mechanism and method of operation thereof
DE102015006528A1 (de) * 2015-05-27 2016-12-01 Roland Harras Verfahren zur Bild- und Filmwiedergabe mit automatischer Fokusierung der Blickbereiche der Betrachter
EP3099078A1 (en) * 2015-05-29 2016-11-30 Thomson Licensing Method for collecting information on users of 4d light field data, corresponding apparatuses and computer programs
US10757399B2 (en) * 2015-09-10 2020-08-25 Google Llc Stereo rendering system
EP3185550A1 (en) 2015-12-23 2017-06-28 Thomson Licensing Tridimensional rendering with adjustable disparity direction
TWI589150B (zh) * 2016-03-04 2017-06-21 液態三維系統有限公司 ３ｄ自動對焦顯示方法及其系統
US10218968B2 (en) * 2016-03-05 2019-02-26 Maximilian Ralph Peter von und zu Liechtenstein Gaze-contingent display technique
EP3264741A1 (en) * 2016-06-30 2018-01-03 Thomson Licensing Plenoptic sub aperture view shuffling with improved resolution
PL3494695T3 (pl) 2016-08-04 2024-02-19 Dolby Laboratories Licensing Corporation Rozwiązania akomodacji-wergencji ze śledzeniem pojedynczej głębi
US10108144B2 (en) * 2016-09-16 2018-10-23 Microsoft Technology Licensing, Llc Holographic wide field of view display
KR102306775B1 (ko) * 2017-03-24 2021-09-29 한국전자통신연구원 사용자 인터렉션 정보를 반영하여 입체영상을 재생하는 방법 및 장치
EP3416371A1 (en) * 2017-06-12 2018-12-19 Thomson Licensing Method for displaying, on a 2d display device, a content derived from light field data
EP3416381A1 (en) 2017-06-12 2018-12-19 Thomson Licensing Method and apparatus for providing information to a user observing a multi view content
SE543121C2 (en) 2019-02-04 2020-10-13 Tobii Ab Method and system for determining a current gaze direction
CN111752383B (zh) * 2019-03-29 2024-09-27 托比股份公司 更新角膜模型
KR102149732B1 (ko) * 2019-04-17 2020-08-31 라쿠텐 인코포레이티드 표시 제어 장치, 표시 제어 방법, 프로그램, 및 비일시적인 컴퓨터 판독 가능한 정보 기록 매체
JP7164047B2 (ja) * 2019-07-10 2022-11-01 日本電気株式会社 注視点検出装置及び注視点検出方法
US10989927B2 (en) * 2019-09-19 2021-04-27 Facebook Technologies, Llc Image frame synchronization in a near eye display
CN110933396A (zh) * 2019-12-12 2020-03-27 中国科学技术大学 集成成像显示系统及其显示方法
CN111031250A (zh) * 2019-12-26 2020-04-17 福州瑞芯微电子股份有限公司 一种基于眼球追踪的重对焦的方法和装置

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20120019703A1 (en) * 2010-07-22 2012-01-26 Thorn Karl Ola Camera system and method of displaying photos

Family Cites Families (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5467104A (en) 1992-10-22 1995-11-14 Board Of Regents Of The University Of Washington Virtual retinal display
US7239293B2 (en) 1998-01-21 2007-07-03 New York University Autostereoscopic display
US6466250B1 (en) 1999-08-09 2002-10-15 Hughes Electronics Corporation System for electronically-mediated collaboration including eye-contact collaboratory
US8559705B2 (en) 2006-12-01 2013-10-15 Lytro, Inc. Interactive refocusing of electronic images
KR100850357B1 (ko) * 2006-12-06 2008-08-04 한국전자통신연구원 시선 위치 추적 방법 및 그 장치
US8786675B2 (en) * 2008-01-23 2014-07-22 Michael F. Deering Systems using eye mounted displays
JP5387856B2 (ja) * 2010-02-16 2014-01-15 ソニー株式会社 画像処理装置、画像処理方法、画像処理プログラムおよび撮像装置
US20110228051A1 (en) 2010-03-17 2011-09-22 Goksel Dedeoglu Stereoscopic Viewing Comfort Through Gaze Estimation
US20110273369A1 (en) 2010-05-10 2011-11-10 Canon Kabushiki Kaisha Adjustment of imaging property in view-dependent rendering
EP2403234A1 (en) 2010-06-29 2012-01-04 Koninklijke Philips Electronics N.V. Method and system for constructing a compound image from data obtained by an array of image capturing devices
US8724000B2 (en) * 2010-08-27 2014-05-13 Adobe Systems Incorporated Methods and apparatus for super-resolution in integral photography
KR101670927B1 (ko) * 2010-11-05 2016-11-01 삼성전자주식회사 디스플레이 장치 및 방법
CN102314683B (zh) * 2011-07-15 2013-01-16 清华大学 一种非平面图像传感器的计算成像方法和成像装置
KR101691633B1 (ko) * 2012-11-01 2017-01-09 아이캠, 엘엘씨 무선 손목 컴퓨팅과 3d 영상화, 매핑, 네트워킹 및 인터페이스를 위한 제어 장치 및 방법

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20120019703A1 (en) * 2010-07-22 2012-01-26 Thorn Karl Ola Camera system and method of displaying photos

Also Published As

Publication number Publication date
CN104798370A (zh) 2015-07-22
JP2016504825A (ja) 2016-02-12
CN104798370B (zh) 2017-05-03
US20140146148A1 (en) 2014-05-29
KR20150090183A (ko) 2015-08-05
WO2014085092A1 (en) 2014-06-05
US9137524B2 (en) 2015-09-15
JP6759371B2 (ja) 2020-09-23
JP2019092170A (ja) 2019-06-13
EP2926554A1 (en) 2015-10-07

Similar Documents

Publication Publication Date Title
KR102164723B1 (ko) 3-d 플레놉틱 비디오 이미지들을 생성하는 시스템 및 방법
US9147111B2 (en) Display with blocking image generation
US9734633B2 (en) Virtual environment generating system
US10497175B2 (en) Augmented reality virtual monitor
EP3855290B1 (en) Remote rendering for virtual images
EP3035681B1 (en) Image processing method and apparatus
US20150312561A1 (en) Virtual 3d monitor
US9681122B2 (en) Modifying displayed images in the coupled zone of a stereoscopic display based on user comfort
KR102204212B1 (ko) 실감형 콘텐츠 제공 장치 및 방법
KR101788452B1 (ko) 시선 인식을 이용하는 콘텐츠 재생 장치 및 방법
CN105264478A (zh) 全息锚定和动态定位
EP3308539A1 (en) Display for stereoscopic augmented reality
US11237413B1 (en) Multi-focal display based on polarization switches and geometric phase lenses
US11543655B1 (en) Rendering for multi-focus display systems
US20220148253A1 (en) Image rendering system and method
WO2019217182A1 (en) Augmented visual capabilities
CN112655202A (zh) 用于头戴式显示器的鱼眼镜头的减小带宽立体失真校正
CN113262464A (zh) 一种虚拟现实场景的动态改变方法、装置及电子设备
WO2019185716A1 (en) Presenting images on a display device
US20240040099A1 (en) Depth of field in video based on gaze
KR102197504B1 (ko) 사전 계산된 조명으로 증강 현실 환경을 구성하는 기법
CN115202475A (zh) 显示方法、装置、电子设备及计算机可读存储介质
US9609313B2 (en) Enhanced 3D display method and system
Nowatzyk et al. Omni-Directional Catadioptric Acquisition System

Legal Events

Date Code Title Description
PA0105 International application

St.27 status event code: A-0-1-A10-A15-nap-PA0105

PG1501 Laying open of application

St.27 status event code: A-1-1-Q10-Q12-nap-PG1501

P22-X000 Classification modified

St.27 status event code: A-2-2-P10-P22-nap-X000

P22-X000 Classification modified

St.27 status event code: A-2-2-P10-P22-nap-X000

P22-X000 Classification modified

St.27 status event code: A-2-2-P10-P22-nap-X000

PA0201 Request for examination

St.27 status event code: A-1-2-D10-D11-exm-PA0201

E902 Notification of reason for refusal
PE0902 Notice of grounds for rejection

St.27 status event code: A-1-2-D10-D21-exm-PE0902

AMND Amendment
E13-X000 Pre-grant limitation requested

St.27 status event code: A-2-3-E10-E13-lim-X000

P11-X000 Amendment of application requested

St.27 status event code: A-2-2-P10-P11-nap-X000

P13-X000 Application amended

St.27 status event code: A-2-2-P10-P13-nap-X000

E601 Decision to refuse application
PE0601 Decision on rejection of patent

St.27 status event code: N-2-6-B10-B15-exm-PE0601

AMND Amendment
E13-X000 Pre-grant limitation requested

St.27 status event code: A-2-3-E10-E13-lim-X000

P11-X000 Amendment of application requested

St.27 status event code: A-2-2-P10-P11-nap-X000

P13-X000 Application amended

St.27 status event code: A-2-2-P10-P13-nap-X000

PX0901 Re-examination

St.27 status event code: A-2-3-E10-E12-rex-PX0901

PX0701 Decision of registration after re-examination

St.27 status event code: A-3-4-F10-F13-rex-PX0701

X701 Decision to grant (after re-examination)
GRNT Written decision to grant
PR0701 Registration of establishment

St.27 status event code: A-2-4-F10-F11-exm-PR0701

PR1002 Payment of registration fee

St.27 status event code: A-2-2-U10-U12-oth-PR1002

Fee payment year number: 1

PG1601 Publication of registration

St.27 status event code: A-4-4-Q10-Q13-nap-PG1601

P22-X000 Classification modified

St.27 status event code: A-4-4-P10-P22-nap-X000

PR1001 Payment of annual fee

St.27 status event code: A-4-4-U10-U11-oth-PR1001

Fee payment year number: 4

PR1001 Payment of annual fee

St.27 status event code: A-4-4-U10-U11-oth-PR1001

Fee payment year number: 5

PR1001 Payment of annual fee

St.27 status event code: A-4-4-U10-U11-oth-PR1001

Fee payment year number: 6

P22-X000 Classification modified

St.27 status event code: A-4-4-P10-P22-nap-X000