CN107278315B - 运动模糊的快速自适应估计以用于相干渲染 - Google Patents

运动模糊的快速自适应估计以用于相干渲染 Download PDF

Info

Publication number
CN107278315B
CN107278315B CN201680012075.9A CN201680012075A CN107278315B CN 107278315 B CN107278315 B CN 107278315B CN 201680012075 A CN201680012075 A CN 201680012075A CN 107278315 B CN107278315 B CN 107278315B
Authority
CN
China
Prior art keywords
image target
target frame
motion blur
pose
estimation method
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CN201680012075.9A
Other languages
English (en)
Chinese (zh)
Other versions
CN107278315A (zh
Inventor
E·门德斯门德斯
K·金
朴荣敏
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Qualcomm Inc
Original Assignee
Qualcomm Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Qualcomm Inc filed Critical Qualcomm Inc
Publication of CN107278315A publication Critical patent/CN107278315A/zh
Application granted granted Critical
Publication of CN107278315B publication Critical patent/CN107278315B/zh
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/20—Analysis of motion
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T13/00—Animation
    • G06T13/80—2D [Two Dimensional] animation, e.g. using sprites
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating 3D models or images for computer graphics
    • G06T19/006—Mixed reality
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00—Image enhancement or restoration
    • G06T5/73—Deblurring; Sharpening
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20016—Hierarchical, coarse-to-fine, multiscale or multiresolution image processing; Pyramid transform
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2215/00—Indexing scheme for image rendering
    • G06T2215/16—Using real world measurements to influence rendering

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Multimedia (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Computer Graphics (AREA)
  • Computer Hardware Design (AREA)
  • General Engineering & Computer Science (AREA)
  • Software Systems (AREA)
  • Image Analysis (AREA)
  • Studio Devices (AREA)
  • Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)
  • Processing Or Creating Images (AREA)
CN201680012075.9A 2015-02-27 2016-01-28 运动模糊的快速自适应估计以用于相干渲染 Expired - Fee Related CN107278315B (zh)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US14/633,737 2015-02-27
US14/633,737 US9684970B2 (en) 2015-02-27 2015-02-27 Fast adaptive estimation of motion blur for coherent rendering
PCT/US2016/015462 WO2016137653A1 (en) 2015-02-27 2016-01-28 Fast adaptive estimation of motion blur for coherent rendering

Publications (2)

Publication Number Publication Date
CN107278315A CN107278315A (zh) 2017-10-20
CN107278315B true CN107278315B (zh) 2020-12-01

Family

ID=55485293

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201680012075.9A Expired - Fee Related CN107278315B (zh) 2015-02-27 2016-01-28 运动模糊的快速自适应估计以用于相干渲染

Country Status (5)

Country Link
US (1) US9684970B2 (enExample)
EP (1) EP3262610B1 (enExample)
JP (1) JP6887951B2 (enExample)
CN (1) CN107278315B (enExample)
WO (1) WO2016137653A1 (enExample)

Families Citing this family (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP3296950A1 (en) * 2016-09-15 2018-03-21 Thomson Licensing Method and device for blurring a virtual object in a video
US10636190B2 (en) * 2018-05-31 2020-04-28 Robert Bosch Gmbh Methods and systems for exploiting per-pixel motion conflicts to extract primary and secondary motions in augmented reality systems
CN109146918B (zh) * 2018-06-11 2022-04-22 西安电子科技大学 一种基于分块的自适应相关目标定位方法
CA3240453A1 (en) * 2019-11-18 2021-05-27 Elbit Systems Ltd. A system and method for mixed reality
US11748954B2 (en) * 2020-06-01 2023-09-05 Snap Inc. Tracking an augmented reality device
US11276201B1 (en) 2020-06-01 2022-03-15 Snap Inc. Localizing an augmented reality device
US11900550B2 (en) 2021-09-30 2024-02-13 Snap Inc. AR odometry using sensor data from a personal vehicle
US20250097402A1 (en) * 2023-09-15 2025-03-20 Apple Inc. Interpolation of reprojected content

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102595171A (zh) * 2012-02-03 2012-07-18 浙江工商大学 一种多通道空时编码孔径的动态光场成像方法和成像系统
CN103491897A (zh) * 2010-12-21 2014-01-01 3形状股份有限公司 运动模糊补偿
CN103745455A (zh) * 2013-12-20 2014-04-23 大连理工大学 一种面向运动模糊的场景空间划分方法

Family Cites Families (36)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP3925415B2 (ja) * 2003-01-22 2007-06-06 ソニー株式会社 画像処理装置および方法、記録媒体、並びにプログラム
US20040258154A1 (en) 2003-06-19 2004-12-23 Microsoft Corporation System and method for multi-stage predictive motion estimation
US7970171B2 (en) 2007-01-18 2011-06-28 Ricoh Co., Ltd. Synthetic image and video generation from ground truth data
JP4755490B2 (ja) * 2005-01-13 2011-08-24 オリンパスイメージング株式会社 ブレ補正方法および撮像装置
US7728909B2 (en) * 2005-06-13 2010-06-01 Seiko Epson Corporation Method and system for estimating motion and compensating for perceived motion blur in digital video
US7852940B2 (en) * 2005-10-20 2010-12-14 Qualcomm Incorporated Scalable motion estimation for video encoding
US20070165961A1 (en) * 2006-01-13 2007-07-19 Juwei Lu Method And Apparatus For Reducing Motion Blur In An Image
US20080170124A1 (en) * 2007-01-12 2008-07-17 Sanyo Electric Co., Ltd. Apparatus and method for blur detection, and apparatus and method for blur correction
JP4799428B2 (ja) * 2007-01-22 2011-10-26 株式会社東芝 画像処理装置及び方法
TW200840365A (en) * 2007-03-23 2008-10-01 Ind Tech Res Inst Motion-blur degraded image restoration method
KR100860967B1 (ko) * 2007-04-16 2008-09-30 삼성전자주식회사 영상의 모션 블러를 제거하기 위한 장치 및 방법
US7843462B2 (en) * 2007-09-07 2010-11-30 Seiko Epson Corporation System and method for displaying a digital video sequence modified to compensate for perceived blur
JP2009081574A (ja) * 2007-09-25 2009-04-16 Toshiba Corp 画像処理装置、方法およびプログラム
JP4881278B2 (ja) * 2007-10-31 2012-02-22 株式会社東芝 物体認識装置及びその方法
EP2072004A1 (en) * 2007-12-19 2009-06-24 Essilor International (Compagnie Generale D'optique) Method of simulating blur in digitally processed images
JP2009217496A (ja) * 2008-03-10 2009-09-24 National Institute Of Information & Communication Technology 画素間の類似尺度をリアルタイムで計算するための装置及びプログラム
JP4666012B2 (ja) * 2008-06-20 2011-04-06 ソニー株式会社 画像処理装置、画像処理方法、プログラム
JP5368765B2 (ja) * 2008-10-21 2013-12-18 キヤノン株式会社 撮影制御装置、撮影装置、撮影制御方法、プログラム、記憶媒体
US8422827B2 (en) * 2009-02-25 2013-04-16 Panasonic Corporation Image correction apparatus and image correction method
TWI564843B (zh) * 2009-07-01 2017-01-01 晨星半導體股份有限公司 移動估測方法及移動估測裝置
US8615141B2 (en) * 2009-08-10 2013-12-24 Seiko Epson Corporation Systems and methods for motion blur reduction
US9218648B2 (en) * 2009-10-27 2015-12-22 Honeywell International Inc. Fourier domain blur estimation method and system
US9030525B2 (en) 2009-12-22 2015-05-12 Thomson Licensing Method and apparatus for optimal motion reproduction in stereoscopic digital cinema
EP2574038B1 (en) * 2010-05-21 2018-10-24 Panasonic Intellectual Property Corporation of America Image capturing apparatus, image processing apparatus, image processing method, and image processing program
JP5543280B2 (ja) * 2010-06-01 2014-07-09 キヤノン株式会社 画像処理装置、画像処理方法
US20120120071A1 (en) 2010-07-16 2012-05-17 Sony Ericsson Mobile Communications Ab Shading graphical objects based on face images
JP5742179B2 (ja) * 2010-11-05 2015-07-01 ソニー株式会社 撮像装置、画像処理装置、および画像処理方法、並びにプログラム
US9036898B1 (en) * 2011-01-18 2015-05-19 Disney Enterprises, Inc. High-quality passive performance capture using anchor frames
WO2012164881A1 (ja) * 2011-05-27 2012-12-06 パナソニック株式会社 画像処理装置および画像処理方法
KR101896026B1 (ko) * 2011-11-08 2018-09-07 삼성전자주식회사 휴대 단말기에서 움직임 블러를 생성하는 장치 및 방법
US9530079B2 (en) * 2012-11-09 2016-12-27 Nikon Corporation Point spread function classification using structural properties
US9152874B2 (en) * 2013-03-13 2015-10-06 Qualcomm Incorporated Motion blur aware visual pose tracking
KR101716928B1 (ko) * 2013-08-22 2017-03-15 주식회사 만도 차량 카메라의 영상 처리 방법 및 이를 이용하는 영상 처리 장치
US9025902B2 (en) * 2013-09-25 2015-05-05 Lucasfilm Entertainment Company Ltd. Post-render motion blur
US10708491B2 (en) * 2014-01-07 2020-07-07 Ml Netherlands C.V. Adaptive camera control for reducing motion blur during real-time image capture
US9674438B2 (en) * 2014-07-06 2017-06-06 Apple Inc. Low light video image stabilization strength modulation

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103491897A (zh) * 2010-12-21 2014-01-01 3形状股份有限公司 运动模糊补偿
CN102595171A (zh) * 2012-02-03 2012-07-18 浙江工商大学 一种多通道空时编码孔径的动态光场成像方法和成像系统
CN103745455A (zh) * 2013-12-20 2014-04-23 大连理工大学 一种面向运动模糊的场景空间划分方法

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
Global motion estimation in frequency and spatial domain;KUMAR ET AL;《PROCEEDING OF ICASSP》;20041231;全文 *

Also Published As

Publication number Publication date
CN107278315A (zh) 2017-10-20
EP3262610A1 (en) 2018-01-03
US9684970B2 (en) 2017-06-20
JP2018513579A (ja) 2018-05-24
WO2016137653A1 (en) 2016-09-01
EP3262610B1 (en) 2020-04-22
US20160253819A1 (en) 2016-09-01
JP6887951B2 (ja) 2021-06-16

Similar Documents

Publication Publication Date Title
CN107278315B (zh) 运动模糊的快速自适应估计以用于相干渲染
JP6456347B2 (ja) 平面固有の特徴のターゲットのｉｎｓｉｔｕ生成
WO2020216054A1 (zh) 视线追踪模型训练的方法、视线追踪的方法及装置
US9478029B2 (en) Selection strategy for exchanging map information in collaborative multi-user SLAM systems
CN108027884B (zh) 一种用于监测对象的方法、存储媒体、服务器及设备
US11335023B2 (en) Human pose estimation using neural networks and kinematic structure
CN114073071B (zh) 视频插帧方法及装置、计算机可读存储介质
JP2016502712A (ja) 単眼視覚ｓｌａｍのための高速初期化
WO2016077000A1 (en) Systems and methods for tracking an object
CN110033423B (zh) 用于处理图像的方法和装置
CN110059623B (zh) 用于生成信息的方法和装置
CN113870399A (zh) 表情驱动方法、装置、电子设备及存储介质
KR20240009993A (ko) 멀티레벨 특징 추적을 위한 직접 스케일 레벨 선택
CN113379877A (zh) 人脸视频生成方法、装置、电子设备及存储介质
US12120453B2 (en) Electronic apparatus and controlling method thereof
US20160140769A1 (en) Edge-aware volumetric depth map fusion
US12394076B2 (en) System and method for facial un-distortion in digital images using multiple imaging sensors
CN107209947B (zh) 在增强现实中使用多个尺度下的特征以用于色彩传递
CN110189364B (zh) 用于生成信息的方法和装置，以及目标跟踪方法和装置
US20250336041A1 (en) Spatiotemporal consistency oriented training framework for ai based stable video generation
CN114972469A (zh) 生成深度图的方法、装置、电子设备和可读存储介质

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20201201

Termination date: 20220128

CF01 Termination of patent right due to non-payment of annual fee