CN104798370B - 用于产生3‑d全光视频图像的系统和方法 - Google Patents

用于产生3‑d全光视频图像的系统和方法 Download PDF

Info

Publication number
CN104798370B
CN104798370B CN201380060783.6A CN201380060783A CN104798370B CN 104798370 B CN104798370 B CN 104798370B CN 201380060783 A CN201380060783 A CN 201380060783A CN 104798370 B CN104798370 B CN 104798370B
Authority
CN
China
Prior art keywords
light image
full light
user
image
plenoptic
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201380060783.6A
Other languages
English (en)
Chinese (zh)
Other versions
CN104798370A (zh
Inventor
朱利亚诺·马乔奇
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Qualcomm Inc
Original Assignee
Qualcomm Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Qualcomm Inc filed Critical Qualcomm Inc
Publication of CN104798370A publication Critical patent/CN104798370A/zh
Application granted granted Critical
Publication of CN104798370B publication Critical patent/CN104798370B/zh
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30Image reproducers
    • H04N13/366Image reproducers using viewer tracking
    • H04N13/383Image reproducers using viewer tracking for tracking with gaze detection, i.e. detecting the lines of sight of the viewer's eyes
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/013Eye tracking input arrangements
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20Image signal generators
    • H04N13/204Image signal generators using stereoscopic image cameras
    • H04N13/207Image signal generators using stereoscopic image cameras using a single 2D image sensor
    • H04N13/232Image signal generators using stereoscopic image cameras using a single 2D image sensor using fly-eye lenses, e.g. arrangements of circular lenses

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)
  • Studio Devices (AREA)
  • Processing Or Creating Images (AREA)
  • Image Processing (AREA)
CN201380060783.6A 2012-11-27 2013-11-13 用于产生3‑d全光视频图像的系统和方法 Active CN104798370B (zh)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US13/686,456 2012-11-27
US13/686,456 US9137524B2 (en) 2012-11-27 2012-11-27 System and method for generating 3-D plenoptic video images
PCT/US2013/069875 WO2014085092A1 (en) 2012-11-27 2013-11-13 System and method for generating 3-d plenoptic video images

Publications (2)

Publication Number Publication Date
CN104798370A CN104798370A (zh) 2015-07-22
CN104798370B true CN104798370B (zh) 2017-05-03

Family

ID=49641897

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201380060783.6A Active CN104798370B (zh) 2012-11-27 2013-11-13 用于产生3‑d全光视频图像的系统和方法

Country Status (6)

Country Link
US (1) US9137524B2 (enExample)
EP (1) EP2926554A1 (enExample)
JP (2) JP2016504825A (enExample)
KR (1) KR102164723B1 (enExample)
CN (1) CN104798370B (enExample)
WO (1) WO2014085092A1 (enExample)

Families Citing this family (31)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TW201426018A (zh) * 2012-12-19 2014-07-01 Ind Tech Res Inst 影像處理裝置及影像再對焦方法
US9699433B2 (en) * 2013-01-24 2017-07-04 Yuchen Zhou Method and apparatus to produce re-focusable vision with detecting re-focusing event from human eye
US20140327771A1 (en) * 2013-05-01 2014-11-06 Nvidia Corporation System, method, and computer program product for displaying a scene as a light field
US9319665B2 (en) * 2013-06-19 2016-04-19 TrackThings LLC Method and apparatus for a self-focusing camera and eyeglass system
US20140375772A1 (en) * 2013-06-19 2014-12-25 Thaddeus Gabara Method and Apparatus for an SR and LR 3-D Visual Images and Sharing
US11343487B2 (en) 2013-10-31 2022-05-24 David Woods Trackable glasses system for perspective views of a display
US9986228B2 (en) 2016-03-24 2018-05-29 3Di Llc Trackable glasses system that provides multiple views of a shared display
US10652525B2 (en) 2013-10-31 2020-05-12 3Di Llc Quad view display system
US10091411B2 (en) * 2014-06-17 2018-10-02 Lg Electronics Inc. Mobile terminal and controlling method thereof for continuously tracking object included in video
CN105323573B (zh) * 2014-07-16 2019-02-05 北京三星通信技术研究有限公司 三维图像显示装置和方法
CN104539924A (zh) * 2014-12-03 2015-04-22 深圳市亿思达科技集团有限公司 基于人眼追踪的全息显示方法及全息显示装置
US9541998B2 (en) * 2015-01-29 2017-01-10 Samsung Electronics Co., Ltd. Electronic system with gaze alignment mechanism and method of operation thereof
DE102015006528A1 (de) * 2015-05-27 2016-12-01 Roland Harras Verfahren zur Bild- und Filmwiedergabe mit automatischer Fokusierung der Blickbereiche der Betrachter
EP3099078A1 (en) * 2015-05-29 2016-11-30 Thomson Licensing Method for collecting information on users of 4d light field data, corresponding apparatuses and computer programs
US10757399B2 (en) * 2015-09-10 2020-08-25 Google Llc Stereo rendering system
EP3185550A1 (en) 2015-12-23 2017-06-28 Thomson Licensing Tridimensional rendering with adjustable disparity direction
TWI589150B (zh) * 2016-03-04 2017-06-21 液態三維系統有限公司 3d自動對焦顯示方法及其系統
US10218968B2 (en) * 2016-03-05 2019-02-26 Maximilian Ralph Peter von und zu Liechtenstein Gaze-contingent display technique
EP3264741A1 (en) * 2016-06-30 2018-01-03 Thomson Licensing Plenoptic sub aperture view shuffling with improved resolution
PL3494695T3 (pl) 2016-08-04 2024-02-19 Dolby Laboratories Licensing Corporation Rozwiązania akomodacji-wergencji ze śledzeniem pojedynczej głębi
US10108144B2 (en) * 2016-09-16 2018-10-23 Microsoft Technology Licensing, Llc Holographic wide field of view display
KR102306775B1 (ko) * 2017-03-24 2021-09-29 한국전자통신연구원 사용자 인터렉션 정보를 반영하여 입체영상을 재생하는 방법 및 장치
EP3416371A1 (en) * 2017-06-12 2018-12-19 Thomson Licensing Method for displaying, on a 2d display device, a content derived from light field data
EP3416381A1 (en) 2017-06-12 2018-12-19 Thomson Licensing Method and apparatus for providing information to a user observing a multi view content
SE543121C2 (en) 2019-02-04 2020-10-13 Tobii Ab Method and system for determining a current gaze direction
CN111752383B (zh) * 2019-03-29 2024-09-27 托比股份公司 更新角膜模型
KR102149732B1 (ko) * 2019-04-17 2020-08-31 라쿠텐 인코포레이티드 표시 제어 장치, 표시 제어 방법, 프로그램, 및 비일시적인 컴퓨터 판독 가능한 정보 기록 매체
JP7164047B2 (ja) * 2019-07-10 2022-11-01 日本電気株式会社 注視点検出装置及び注視点検出方法
US10989927B2 (en) * 2019-09-19 2021-04-27 Facebook Technologies, Llc Image frame synchronization in a near eye display
CN110933396A (zh) * 2019-12-12 2020-03-27 中国科学技术大学 集成成像显示系统及其显示方法
CN111031250A (zh) * 2019-12-26 2020-04-17 福州瑞芯微电子股份有限公司 一种基于眼球追踪的重对焦的方法和装置

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20080131019A1 (en) * 2006-12-01 2008-06-05 Yi-Ren Ng Interactive Refocusing of Electronic Images
CN102164293A (zh) * 2010-02-16 2011-08-24 索尼公司 图像处理装置、图像处理方法、图像处理程序和成像装置
US20110273369A1 (en) * 2010-05-10 2011-11-10 Canon Kabushiki Kaisha Adjustment of imaging property in view-dependent rendering
EP2403234A1 (en) * 2010-06-29 2012-01-04 Koninklijke Philips Electronics N.V. Method and system for constructing a compound image from data obtained by an array of image capturing devices
CN102314683A (zh) * 2011-07-15 2012-01-11 清华大学 一种非平面图像传感器的计算成像方法和成像装置

Family Cites Families (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5467104A (en) 1992-10-22 1995-11-14 Board Of Regents Of The University Of Washington Virtual retinal display
US7239293B2 (en) 1998-01-21 2007-07-03 New York University Autostereoscopic display
US6466250B1 (en) 1999-08-09 2002-10-15 Hughes Electronics Corporation System for electronically-mediated collaboration including eye-contact collaboratory
KR100850357B1 (ko) * 2006-12-06 2008-08-04 한국전자통신연구원 시선 위치 추적 방법 및 그 장치
US8786675B2 (en) * 2008-01-23 2014-07-22 Michael F. Deering Systems using eye mounted displays
US20110228051A1 (en) 2010-03-17 2011-09-22 Goksel Dedeoglu Stereoscopic Viewing Comfort Through Gaze Estimation
US20120019703A1 (en) * 2010-07-22 2012-01-26 Thorn Karl Ola Camera system and method of displaying photos
US8724000B2 (en) * 2010-08-27 2014-05-13 Adobe Systems Incorporated Methods and apparatus for super-resolution in integral photography
KR101670927B1 (ko) * 2010-11-05 2016-11-01 삼성전자주식회사 디스플레이 장치 및 방법
KR101691633B1 (ko) * 2012-11-01 2017-01-09 아이캠, 엘엘씨 무선 손목 컴퓨팅과 3d 영상화, 매핑, 네트워킹 및 인터페이스를 위한 제어 장치 및 방법

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20080131019A1 (en) * 2006-12-01 2008-06-05 Yi-Ren Ng Interactive Refocusing of Electronic Images
CN102164293A (zh) * 2010-02-16 2011-08-24 索尼公司 图像处理装置、图像处理方法、图像处理程序和成像装置
US20110273369A1 (en) * 2010-05-10 2011-11-10 Canon Kabushiki Kaisha Adjustment of imaging property in view-dependent rendering
EP2403234A1 (en) * 2010-06-29 2012-01-04 Koninklijke Philips Electronics N.V. Method and system for constructing a compound image from data obtained by an array of image capturing devices
CN102314683A (zh) * 2011-07-15 2012-01-11 清华大学 一种非平面图像传感器的计算成像方法和成像装置

Also Published As

Publication number Publication date
CN104798370A (zh) 2015-07-22
JP2016504825A (ja) 2016-02-12
KR102164723B1 (ko) 2020-10-13
US20140146148A1 (en) 2014-05-29
KR20150090183A (ko) 2015-08-05
WO2014085092A1 (en) 2014-06-05
US9137524B2 (en) 2015-09-15
JP6759371B2 (ja) 2020-09-23
JP2019092170A (ja) 2019-06-13
EP2926554A1 (en) 2015-10-07

Similar Documents

Publication Publication Date Title
CN104798370B (zh) 用于产生3‑d全光视频图像的系统和方法
US9147111B2 (en) Display with blocking image generation
US10497175B2 (en) Augmented reality virtual monitor
CN108351691B (zh) 用于虚拟图像的远程渲染
US20150312561A1 (en) Virtual 3d monitor
KR20220093144A (ko) 눈 추적기를 통합하는 라이트 필드 디스플레이 및 눈 추적 정보를 사용하여 라이트 필드 디스플레이에 대한 뷰를 생성하기 위한 방법
US20120200667A1 (en) Systems and methods to facilitate interactions with virtual content
TWI669635B (zh) 用於顯示彈幕的方法、裝置以及非揮發性電腦可讀儲存介質
WO2017086263A1 (ja) 情報処理装置および画像生成方法
CN105264478A (zh) 全息锚定和动态定位
KR102204212B1 (ko) 실감형 콘텐츠 제공 장치 및 방법
US9681122B2 (en) Modifying displayed images in the coupled zone of a stereoscopic display based on user comfort
KR20140014160A (ko) 실감형 디스플레이 경험
JP2014504413A (ja) 理解および意図に基づく拡張現実表示用コンテンツ
CN107810634A (zh) 用于立体增强现实的显示器
TWI839578B (zh) 3d顯示系統與3d顯示方法
CN105894567A (zh) 放缩三维场景中的用户控制的虚拟对象的像素深度值
US20220148253A1 (en) Image rendering system and method
CN106327584A (zh) 一种用于虚拟现实设备的图像处理方法及装置
KR20200115631A (ko) 멀티뷰잉 가상 현실 사용자 인터페이스
WO2020215960A1 (zh) 注视区域的确定方法、装置及可穿戴设备
US12143561B2 (en) Image generation system and method
KR102197504B1 (ko) 사전 계산된 조명으로 증강 현실 환경을 구성하는 기법
CN115202475A (zh) 显示方法、装置、电子设备及计算机可读存储介质
US9609313B2 (en) Enhanced 3D display method and system

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant