CN107534718A - 光场的元数据 - Google Patents

光场的元数据 Download PDF

Info

Publication number
CN107534718A
CN107534718A CN201680022582.0A CN201680022582A CN107534718A CN 107534718 A CN107534718 A CN 107534718A CN 201680022582 A CN201680022582 A CN 201680022582A CN 107534718 A CN107534718 A CN 107534718A
Authority
CN
China
Prior art keywords
light field
field data
light
data
metadata
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201680022582.0A
Other languages
English (en)
Chinese (zh)
Inventor
G.布瓦松
M.塞菲
B.范达姆
N.萨巴特
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
InterDigital VC Holdings Inc
Original Assignee
Thomson Licensing SAS
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Thomson Licensing SAS filed Critical Thomson Licensing SAS
Publication of CN107534718A publication Critical patent/CN107534718A/zh
Pending legal-status Critical Current

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/204—Image signal generators using stereoscopic image cameras
    • H04N13/207—Image signal generators using stereoscopic image cameras using a single two-dimensional [2D] image sensor
    • H04N13/232—Image signal generators using stereoscopic image cameras using a single two-dimensional [2D] image sensor using fly-eye lenses, e.g. arrangements of circular lenses
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/80—Analysis of captured images to determine intrinsic or extrinsic camera parameters, i.e. camera calibration
    • G06T7/85—Stereo camera calibration
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/50—Depth or shape recovery
    • G06T7/55—Depth or shape recovery from multiple images
    • G06T7/557—Depth or shape recovery from multiple images from light fields, e.g. from plenoptic cameras
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106—Processing image signals
    • H04N13/111—Transformation of image signals corresponding to virtual viewpoints, e.g. spatial image interpolation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106—Processing image signals
    • H04N13/172—Processing image signals image signals comprising non-image signal components, e.g. headers or format information
    • H04N13/178—Metadata, e.g. disparity information
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/204—Image signal generators using stereoscopic image cameras
    • H04N13/207—Image signal generators using stereoscopic image cameras using a single two-dimensional [2D] image sensor
    • H04N13/218—Image signal generators using stereoscopic image cameras using a single two-dimensional [2D] image sensor using spatial multiplexing
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/204—Image signal generators using stereoscopic image cameras
    • H04N13/207—Image signal generators using stereoscopic image cameras using a single two-dimensional [2D] image sensor
    • H04N13/229—Image signal generators using stereoscopic image cameras using a single two-dimensional [2D] image sensor using lenticular lenses, e.g. arrangements of cylindrical lenses
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/282—Image signal generators for generating image signals corresponding to three or more geometrical viewpoints, e.g. multi-view systems
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/67—Focus control based on electronic image sensor signals
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/95—Computational photography systems, e.g. light-field imaging systems
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/95—Computational photography systems, e.g. light-field imaging systems
    • H04N23/957—Light-field or plenoptic cameras or camera modules
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10024—Color image
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10028—Range image; Depth image; 3D point clouds
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10052—Images from lightfield camera
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H04N25/10—Circuitry of solid-state image sensors [SSIS]; Control thereof for transforming different wavelengths into image signals
    • H04N25/11—Arrangement of colour filter arrays [CFA]; Filter mosaics
    • H04N25/13—Arrangement of colour filter arrays [CFA]; Filter mosaics characterised by the spectral characteristics of the filter elements
    • H04N25/133—Arrangement of colour filter arrays [CFA]; Filter mosaics characterised by the spectral characteristics of the filter elements including elements passing panchromatic light, e.g. filters passing white light
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H04N25/10—Circuitry of solid-state image sensors [SSIS]; Control thereof for transforming different wavelengths into image signals
    • H04N25/11—Arrangement of colour filter arrays [CFA]; Filter mosaics
    • H04N25/13—Arrangement of colour filter arrays [CFA]; Filter mosaics characterised by the spectral characteristics of the filter elements
    • H04N25/134—Arrangement of colour filter arrays [CFA]; Filter mosaics characterised by the spectral characteristics of the filter elements based on three different wavelength filter elements
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H04N25/10—Circuitry of solid-state image sensors [SSIS]; Control thereof for transforming different wavelengths into image signals
    • H04N25/11—Arrangement of colour filter arrays [CFA]; Filter mosaics
    • H04N25/13—Arrangement of colour filter arrays [CFA]; Filter mosaics characterised by the spectral characteristics of the filter elements
    • H04N25/135—Arrangement of colour filter arrays [CFA]; Filter mosaics characterised by the spectral characteristics of the filter elements based on four or more different wavelength filter elements
    • H04N25/136—Arrangement of colour filter arrays [CFA]; Filter mosaics characterised by the spectral characteristics of the filter elements based on four or more different wavelength filter elements using complementary colours

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Theoretical Computer Science (AREA)
  • Computing Systems (AREA)
  • Library & Information Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Studio Devices (AREA)
  • Exposure Control For Cameras (AREA)
  • Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)
CN201680022582.0A 2015-03-05 2016-02-26 光场的元数据 Pending CN107534718A (zh)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
EP15305340.0 2015-03-05
EP15305340.0A EP3065394A1 (en) 2015-03-05 2015-03-05 Light field metadata
PCT/EP2016/054041 WO2016139134A1 (en) 2015-03-05 2016-02-26 Light field metadata

Publications (1)

Publication Number Publication Date
CN107534718A true CN107534718A (zh) 2018-01-02

Family

ID=52774156

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201680022582.0A Pending CN107534718A (zh) 2015-03-05 2016-02-26 光场的元数据

Country Status (11)

Country Link
US (1) US20180047185A1 (cg-RX-API-DMAC10.html)
EP (2) EP3065394A1 (cg-RX-API-DMAC10.html)
JP (1) JP2018514969A (cg-RX-API-DMAC10.html)
KR (1) KR20170125078A (cg-RX-API-DMAC10.html)
CN (1) CN107534718A (cg-RX-API-DMAC10.html)
BR (1) BR112017019004A2 (cg-RX-API-DMAC10.html)
CA (1) CA2978072A1 (cg-RX-API-DMAC10.html)
MX (1) MX2017011323A (cg-RX-API-DMAC10.html)
RU (1) RU2017134151A (cg-RX-API-DMAC10.html)
TW (1) TW201633773A (cg-RX-API-DMAC10.html)
WO (1) WO2016139134A1 (cg-RX-API-DMAC10.html)

Families Citing this family (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP3145168A1 (en) * 2015-09-17 2017-03-22 Thomson Licensing An apparatus and a method for generating data representing a pixel beam
EP3270589A1 (en) * 2016-07-11 2018-01-17 Thomson Licensing An apparatus and a method for generating data representative of a pixel beam
WO2018024490A1 (en) * 2016-08-05 2018-02-08 Thomson Licensing A method for obtaining at least one sub-aperture image being associated with one view
US20200128188A1 (en) * 2016-09-30 2020-04-23 Nikon Corporation Image pickup device and image pickup system
KR102646437B1 (ko) 2016-11-25 2024-03-11 삼성전자주식회사 멀티 렌즈 기반의 촬영 장치 및 방법
JP6668298B2 (ja) * 2017-08-30 2020-03-18 株式会社東芝 スマートカメラ、画像処理装置、スマートカメラシステム、データ送信方法およびプログラム
WO2019039507A1 (ja) * 2017-08-22 2019-02-28 株式会社 東芝 スマートカメラ、画像処理装置、およびデータ通信方法
US12069383B2 (en) * 2017-09-15 2024-08-20 Kent Imaging Inc. Hybrid visible and near infrared imaging with an RGB color filter array sensor
RU2690757C1 (ru) 2018-08-21 2019-06-05 Самсунг Электроникс Ко., Лтд. Система синтеза промежуточных видов светового поля и способ ее функционирования
KR102689953B1 (ko) 2018-12-03 2024-07-31 삼성전자주식회사 캘리브레이션 방법 및 장치
CN110389140A (zh) * 2019-07-11 2019-10-29 中国科学院上海应用物理研究所 实现元素空间定位的双能焦点堆栈三维重构方法
WO2021249955A1 (en) * 2020-06-09 2021-12-16 Interdigital Vc Holdings France, Sas Metadata to describe color filter on top on camera sensors
WO2022120104A2 (en) * 2020-12-04 2022-06-09 Dolby Laboratories Licensing Corporation Processing of extended dimension light field images
WO2023058889A1 (ko) * 2021-10-05 2023-04-13 엘지전자 주식회사 광 캡쳐 장치 및 이를 구비하는 광 캡쳐 시스템
JP7849080B2 (ja) * 2022-03-17 2026-04-21 株式会社クビットバイオ ライトフィールド顕微鏡ベースの画像取得方法及び装置
JP7815043B2 (ja) * 2022-06-16 2026-02-17 キヤノン株式会社 画像処理装置、画像処理方法、及びプログラム

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20120249550A1 (en) * 2009-04-18 2012-10-04 Lytro, Inc. Selective Transmission of Image Data Based on Device Attributes
US20130077880A1 (en) * 2011-09-28 2013-03-28 Pelican Imaging Corporation Systems and methods for encoding light field image files
WO2014204009A1 (en) * 2013-06-21 2014-12-24 Canon Kabushiki Kaisha Apparatus, system, and method for processing information and program for the same
US20150264246A1 (en) * 2014-03-11 2015-09-17 Sony Corporation Method, electronic device, and server for generating digitally processed pictures

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2004120069A (ja) * 2002-09-24 2004-04-15 Canon Inc 画像処理装置、画像処理方法および該方法を実現するためのプログラム
US20100265385A1 (en) * 2009-04-18 2010-10-21 Knight Timothy J Light Field Camera Image, File and Configuration Data, and Methods of Using, Storing and Communicating Same
JP2013255172A (ja) * 2012-06-08 2013-12-19 Canon Inc 画像処理装置及び画像処理方法

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20120249550A1 (en) * 2009-04-18 2012-10-04 Lytro, Inc. Selective Transmission of Image Data Based on Device Attributes
US20130077880A1 (en) * 2011-09-28 2013-03-28 Pelican Imaging Corporation Systems and methods for encoding light field image files
WO2014204009A1 (en) * 2013-06-21 2014-12-24 Canon Kabushiki Kaisha Apparatus, system, and method for processing information and program for the same
US20150264246A1 (en) * 2014-03-11 2015-09-17 Sony Corporation Method, electronic device, and server for generating digitally processed pictures

Also Published As

Publication number Publication date
JP2018514969A (ja) 2018-06-07
MX2017011323A (es) 2017-12-07
BR112017019004A2 (en) 2018-04-17
EP3065394A1 (en) 2016-09-07
RU2017134151A3 (cg-RX-API-DMAC10.html) 2019-10-02
CA2978072A1 (en) 2016-09-09
WO2016139134A1 (en) 2016-09-09
US20180047185A1 (en) 2018-02-15
TW201633773A (zh) 2016-09-16
KR20170125078A (ko) 2017-11-13
RU2017134151A (ru) 2019-04-03
EP3266194A1 (en) 2018-01-10

Similar Documents

Publication Publication Date Title
EP3065394A1 (en) Light field metadata
US10311649B2 (en) Systems and method for performing depth based image editing
US10425632B2 (en) Imaging apparatus and image sensor array
Birklbauer et al. Panorama light‐field imaging
US10887576B2 (en) Light field data representation
CN206759600U (zh) 成像系统
EP3065395A1 (en) Processing of light field data
KR20140094395A (ko) 복수 개의 마이크로렌즈를 사용하여 촬영하는 촬영 장치 및 그 촬영 방법
CN102710902A (zh) 多通道图像传感器
JP2018514969A5 (cg-RX-API-DMAC10.html)
WO2023275032A1 (en) Nona-pixel color filter array
CN111727453B (zh) 用于去马赛克的滤波器阵列
CN108805921A (zh) 图像获取系统及方法
US11882259B2 (en) Light field data representation
CN111787237B (zh) 像素、图像传感器、对焦方法、装置及终端设备
EP3657786A1 (en) Light field reconstruction
US20240127407A1 (en) Image sensor apparatus for capturing depth information
CN216873256U (zh) 共用微透镜部分遮挡相位对焦的图像传感器
EP3144884A1 (en) Light field data representation
CN119450250A (zh) 使用透镜阵列获得图像的装置和方法

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
TA01 Transfer of patent application right
TA01 Transfer of patent application right

Effective date of registration: 20190916

Address after: Delaware

Applicant after: Interactive Digital VC Holding Company

Address before: I Si Eli Murli Nor, France

Applicant before: Thomson Licensing SA

WD01 Invention patent application deemed withdrawn after publication
WD01 Invention patent application deemed withdrawn after publication

Application publication date: 20180102