CN108605119B - 2d到3d视频帧转换 - Google Patents

2d到3d视频帧转换 Download PDF

Info

Publication number
CN108605119B
CN108605119B CN201680056142.7A CN201680056142A CN108605119B CN 108605119 B CN108605119 B CN 108605119B CN 201680056142 A CN201680056142 A CN 201680056142A CN 108605119 B CN108605119 B CN 108605119B
Authority
CN
China
Prior art keywords
depth
image
video frame
input video
depth information
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CN201680056142.7A
Other languages
English (en)
Chinese (zh)
Other versions
CN108605119A (zh
Inventor
M·M·赫菲达
K·A·A·卡拉加里
M·A·A·M·埃尔克哈利比
W·毛图希克
P·蒂迪克
A·卡斯帕
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Individual
Original Assignee
Individual
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Individual filed Critical Individual
Publication of CN108605119A publication Critical patent/CN108605119A/zh
Application granted granted Critical
Publication of CN108605119B publication Critical patent/CN108605119B/zh
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/261—Image signal generators with monoscopic-to-stereoscopic image conversion
    • H04N13/268—Image signal generators with monoscopic-to-stereoscopic image conversion based on depth image-based rendering [DIBR]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/261—Image signal generators with monoscopic-to-stereoscopic image conversion
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/70—Information retrieval; Database structures therefor; File system structures therefor of video data
    • G06F16/73—Querying
    • G06F16/738—Presentation of query results
    • G06F16/739—Presentation of query results in form of a video summary, e.g. the video summary being a video sequence, a composite still image or having synthesized frames
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/10—Segmentation; Edge detection
    • G06T7/11—Region-based segmentation
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/50—Depth or shape recovery
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/50—Depth or shape recovery
    • G06T7/55—Depth or shape recovery from multiple images
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10016—Video; Image sequence
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20021—Dividing image into blocks, subimages or windows
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N2013/0074—Stereoscopic image analysis
    • H04N2013/0088—Synthesising a monoscopic image signal from stereoscopic images, e.g. synthesising a panoramic or high resolution monoscopic image

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Multimedia (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Signal Processing (AREA)
  • Data Mining & Analysis (AREA)
  • Computational Linguistics (AREA)
  • Databases & Information Systems (AREA)
  • General Engineering & Computer Science (AREA)
  • Processing Or Creating Images (AREA)
  • Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)
  • Image Processing (AREA)
  • Image Analysis (AREA)
  • Studio Devices (AREA)
CN201680056142.7A 2015-08-03 2016-08-03 2d到3d视频帧转换 Expired - Fee Related CN108605119B (zh)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US201562200311P 2015-08-03 2015-08-03
US62/200,311 2015-08-03
PCT/GB2016/052388 WO2017021731A1 (en) 2015-08-03 2016-08-03 2d-to-3d video frame conversion

Publications (2)

Publication Number Publication Date
CN108605119A CN108605119A (zh) 2018-09-28
CN108605119B true CN108605119B (zh) 2020-12-01

Family

ID=56787639

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201680056142.7A Expired - Fee Related CN108605119B (zh) 2015-08-03 2016-08-03 2d到3d视频帧转换

Country Status (11)

Country Link
US (2) US10425634B2 (enExample)
EP (1) EP3326364A1 (enExample)
JP (1) JP6903657B2 (enExample)
KR (1) KR20180094835A (enExample)
CN (1) CN108605119B (enExample)
AU (1) AU2016302049C1 (enExample)
BR (1) BR112018002224A8 (enExample)
CA (1) CA2994514A1 (enExample)
IL (1) IL257304B (enExample)
MX (1) MX377805B (enExample)
WO (1) WO2017021731A1 (enExample)

Families Citing this family (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP3236657A1 (en) * 2016-04-21 2017-10-25 Ultra-D Coöperatief U.A. Dual mode depth estimator
JP2019015553A (ja) * 2017-07-05 2019-01-31 ソニーセミコンダクタソリューションズ株式会社 情報処理装置、情報処理方法および個体撮像装置
US10735707B2 (en) 2017-08-15 2020-08-04 International Business Machines Corporation Generating three-dimensional imagery
US11113887B2 (en) * 2018-01-08 2021-09-07 Verizon Patent And Licensing Inc Generating three-dimensional content from two-dimensional images
US11949889B2 (en) * 2018-01-19 2024-04-02 Interdigital Vc Holdings, Inc. Processing a point cloud
US10991150B2 (en) 2018-05-09 2021-04-27 Massachusetts Institute Of Technology View generation from a single image using fully convolutional neural networks
US20200137380A1 (en) * 2018-10-31 2020-04-30 Intel Corporation Multi-plane display image synthesis mechanism
TWI756956B (zh) * 2020-12-01 2022-03-01 財團法人工業技術研究院 用於環景影像的影像處理方法及裝置
US12217359B2 (en) 2021-03-10 2025-02-04 Joseph Gratz Three-dimensional rendering of sporting event from two-dimensional video stream
CN113793255A (zh) * 2021-09-09 2021-12-14 百度在线网络技术（北京）有限公司 用于图像处理的方法、装置、设备、存储介质和程序产品
CN114913215B (zh) * 2021-11-25 2025-08-15 原力聚合(重庆)机器人科技有限公司 深度估计方法和深度估计装置
CN115019227B (zh) * 2022-05-16 2025-04-29 咪咕文化科技有限公司 基于ai的视频处理方法、装置、设备及可读存储介质
US20250104197A1 (en) * 2023-09-26 2025-03-27 Adobe Inc. Interactively refining a digital image depth map for non destructive synthetic lens blur

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102999937A (zh) * 2011-09-08 2013-03-27 上海翰攀信息科技有限公司 心脏散乱点云数据曲面重建的方法

Family Cites Families (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7254265B2 (en) * 2000-04-01 2007-08-07 Newsight Corporation Methods and systems for 2D/3D image conversion and optimization
US8401336B2 (en) 2001-05-04 2013-03-19 Legend3D, Inc. System and method for rapid image sequence depth enhancement with augmented computer-generated elements
US20080309662A1 (en) * 2005-12-14 2008-12-18 Tal Hassner Example Based 3D Reconstruction
TW201005673A (en) * 2008-07-18 2010-02-01 Ind Tech Res Inst Example-based two-dimensional to three-dimensional image conversion method, computer readable medium therefor, and system
US8311285B2 (en) * 2009-06-30 2012-11-13 Mitsubishi Electric Research Laboratories, Inc. Method and system for localizing in urban environments from omni-direction skyline images
US8610758B2 (en) * 2009-12-15 2013-12-17 Himax Technologies Limited Depth map generation for a video conversion system
JP5132754B2 (ja) * 2010-11-10 2013-01-30 株式会社東芝 画像処理装置、方法およびそのプログラム
US9471988B2 (en) * 2011-11-02 2016-10-18 Google Inc. Depth-map generation for an input image using an example approximate depth-map associated with an example similar image
US9414048B2 (en) 2011-12-09 2016-08-09 Microsoft Technology Licensing, Llc Automatic 2D-to-stereoscopic video conversion
EP2742441A1 (en) 2012-05-24 2014-06-18 Qatar Foundation A method and system for creating depth signatures
US20140210944A1 (en) * 2013-01-30 2014-07-31 Samsung Electronics Co., Ltd. Method and apparatus for converting 2d video to 3d video
US9373171B2 (en) * 2013-07-22 2016-06-21 Stmicroelectronics S.R.L. Method for generating a depth map, related system and computer program product
EP2887311B1 (en) * 2013-12-20 2016-09-14 Thomson Licensing Method and apparatus for performing depth estimation

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102999937A (zh) * 2011-09-08 2013-03-27 上海翰攀信息科技有限公司 心脏散乱点云数据曲面重建的方法

Also Published As

Publication number Publication date
US10834379B2 (en) 2020-11-10
MX377805B (es) 2025-03-11
CN108605119A (zh) 2018-09-28
EP3326364A1 (en) 2018-05-30
KR20180094835A (ko) 2018-08-24
JP2018528733A (ja) 2018-09-27
IL257304A (en) 2018-06-28
AU2016302049C1 (en) 2021-01-07
US20200053345A1 (en) 2020-02-13
JP6903657B2 (ja) 2021-07-14
WO2017021731A1 (en) 2017-02-09
US20180227574A1 (en) 2018-08-09
AU2016302049B2 (en) 2020-10-01
AU2016302049A1 (en) 2018-03-29
MX2018001450A (es) 2018-05-28
BR112018002224A8 (pt) 2020-09-08
BR112018002224A2 (pt) 2019-02-19
IL257304B (en) 2020-09-30
CA2994514A1 (en) 2017-02-09
US10425634B2 (en) 2019-09-24

Similar Documents

Publication Publication Date Title
CN108605119B (zh) 2d到3d视频帧转换
Rematas et al. Soccer on your tabletop
Guttmann et al. Semi-automatic stereo extraction from video footage
Cao et al. Semi-automatic 2D-to-3D conversion using disparity propagation
Niu et al. 2D and 3D image quality assessment: A survey of metrics and challenges
US10542249B2 (en) Stereoscopic video generation method based on 3D convolution neural network
Feng et al. Object-based 2D-to-3D video conversion for effective stereoscopic content generation in 3D-TV applications
Wang et al. Quaternion representation based visual saliency for stereoscopic image quality assessment
WO2022126674A1 (zh) 立体全景图像的质量评价方法、系统
CN106548494A (zh) 一种基于场景样本库的影视图像深度提取方法
CN109408672A (zh) 一种文章生成方法、装置、服务器及存储介质
CN111178163B (zh) 基于立方体投影格式的立体全景图像显著区域预测方法
Calagari et al. Gradient-based 2D-to-3D conversion for soccer videos
Calagari et al. Data driven 2-D-to-3-D video conversion for soccer
CN110012284A (zh) 一种基于头戴设备的视频播放方法及装置
CN104052990B (zh) 一种基于融合深度线索的全自动二维转三维方法和装置
Zhang et al. An interactive system of stereoscopic video conversion
CN111526354A (zh) 一种基于多尺度空间视差信息的立体视频舒适度预测方法
Zhou et al. Stereoscopic image discomfort prediction using dual-stream multi-level interactive network
CN116980549A (zh) 视频帧处理方法、装置、计算机设备和存储介质
CN113627367A (zh) 一种基于多维信息聚合的立体视频显著性检测方法
US20200020090A1 (en) 3D Moving Object Point Cloud Refinement Using Temporal Inconsistencies
Didyk et al. Data Driven 2D-to-3D Video Conversion for Soccer
Lu et al. Automatically optimised stereoscopic camera control based on an assessment of 3D video quality of experience
Xu Capturing and post-processing of stereoscopic 3D content for improved quality of experience

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20201201

Termination date: 20210803

CF01 Termination of patent right due to non-payment of annual fee