CN111373441B - 使用运动估计的随时间注视点渲染 - Google Patents

使用运动估计的随时间注视点渲染 Download PDF

Info

Publication number
CN111373441B
CN111373441B CN201880075127.6A CN201880075127A CN111373441B CN 111373441 B CN111373441 B CN 111373441B CN 201880075127 A CN201880075127 A CN 201880075127A CN 111373441 B CN111373441 B CN 111373441B
Authority
CN
China
Prior art keywords
image
pixel
pixels
motion vector
cells
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201880075127.6A
Other languages
English (en)
Chinese (zh)
Other versions
CN111373441A (zh
Inventor
伊哈卜·阿梅尔
盖纳迪·里盖
吴瑞金
斯凯勒·J·萨利赫
鲍里斯·伊万诺维奇
加博尔·西尼斯
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
ATI Technologies ULC
Advanced Micro Devices Inc
Original Assignee
ATI Technologies ULC
Advanced Micro Devices Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by ATI Technologies ULC, Advanced Micro Devices Inc filed Critical ATI Technologies ULC
Publication of CN111373441A publication Critical patent/CN111373441A/zh
Application granted granted Critical
Publication of CN111373441B publication Critical patent/CN111373441B/zh
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/00—Three-dimensional [3D] image rendering
    • G06T15/10—Geometric effects
    • G06T15/20—Perspective computation
    • G06T15/205—Image-based rendering
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00—Geometric image transformations in the plane of the image
    • G06T3/40—Scaling of whole images or parts thereof, e.g. expanding or contracting
    • G06T3/403—Edge-driven scaling; Edge-based scaling
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/20—Analysis of motion
    • G06T7/223—Analysis of motion using block-matching
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/00—Three-dimensional [3D] image rendering
    • G06T15/005—General purpose rendering architectures
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00—Image enhancement or restoration
    • G06T5/50—Image enhancement or restoration using two or more images, e.g. averaging or subtraction
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00—Image enhancement or restoration
    • G06T5/77—Retouching; Inpainting; Scratch removal
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/10—Segmentation; Edge detection
    • G06T7/13—Edge detection
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/10—Segmentation; Edge detection
    • G06T7/136—Segmentation; Edge detection involving thresholding
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/20—Analysis of motion
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/20—Analysis of motion
    • G06T7/246—Analysis of motion using feature-based methods, e.g. the tracking of corners or segments
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/20—Analysis of motion
    • G06T7/246—Analysis of motion using feature-based methods, e.g. the tracking of corners or segments
    • G06T7/248—Analysis of motion using feature-based methods, e.g. the tracking of corners or segments involving reference images or patches
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10016—Video; Image sequence
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20021—Dividing image into blocks, subimages or windows
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2210/00—Indexing scheme for image generation or computer graphics
    • G06T2210/08—Bandwidth reduction

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Multimedia (AREA)
  • Computer Graphics (AREA)
  • Computing Systems (AREA)
  • Geometry (AREA)
  • Image Analysis (AREA)
  • Television Systems (AREA)
CN201880075127.6A 2017-11-20 2018-09-19 使用运动估计的随时间注视点渲染 Active CN111373441B (zh)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US15/818,072 2017-11-20
US15/818,072 US10169843B1 (en) 2017-11-20 2017-11-20 Temporal foveated rendering using motion estimation
PCT/US2018/051732 WO2019099101A1 (en) 2017-11-20 2018-09-19 Temporal foveated rendering using motion estimation

Publications (2)

Publication Number Publication Date
CN111373441A CN111373441A (zh) 2020-07-03
CN111373441B true CN111373441B (zh) 2022-06-03

Family

ID=64739845

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201880075127.6A Active CN111373441B (zh) 2017-11-20 2018-09-19 使用运动估计的随时间注视点渲染

Country Status (6)

Country Link
US (1) US10169843B1 (https=)
EP (1) EP3714435B1 (https=)
JP (1) JP2021503669A (https=)
KR (1) KR102398599B1 (https=)
CN (1) CN111373441B (https=)
WO (1) WO2019099101A1 (https=)

Families Citing this family (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11611773B2 (en) * 2018-04-06 2023-03-21 Qatar Foundation For Education, Science And Community Development System of video steganalysis and a method for the detection of covert communications
US11381825B2 (en) 2018-11-27 2022-07-05 Advanced Micro Devices, Inc. Variable rate rendering based on motion estimation
KR102837402B1 (ko) 2019-07-28 2025-07-23 구글 엘엘씨 포비에이티드 메시들로 몰입형 비디오 콘텐츠를 렌더링하기 위한 방법들, 시스템들, 및 매체들
US11363247B2 (en) * 2020-02-14 2022-06-14 Valve Corporation Motion smoothing in a distributed system
US11361545B1 (en) * 2020-11-20 2022-06-14 Himax Technologies Limited Monitoring device for detecting object of interest and operation method thereof
CN114786051B (zh) * 2022-03-31 2023-04-14 北京百度网讯科技有限公司 一种视频渲染方法、装置、电子设备及存储介质
US12488769B2 (en) * 2023-03-30 2025-12-02 Apple Inc. Content based foveation

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102342102A (zh) * 2008-12-31 2012-02-01 先进微装置公司 具有先进的空间过滤差动矢量的多候选运动估计
CN102461150A (zh) * 2009-04-23 2012-05-16 想象技术有限公司 在运动估计系统中使用动量和加速度矢量的对象跟踪
CN103929568A (zh) * 2013-01-11 2014-07-16 索尼公司 用于稳定数字图像帧的第一序列的方法以及图像稳定单元
CN105225264A (zh) * 2014-06-27 2016-01-06 三星电子株式会社 基于运动的自适应渲染
US9811914B2 (en) * 2013-06-17 2017-11-07 Immedia Semiconductor, Inc. Multi-window image processing and motion compensation

Family Cites Families (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9384564B2 (en) * 2007-11-19 2016-07-05 Microsoft Technology Licensing, Llc Rendering of data sets comprising multiple-resolution samples
US9897805B2 (en) * 2013-06-07 2018-02-20 Sony Interactive Entertainment Inc. Image rendering responsive to user actions in head mounted display
US20130202194A1 (en) * 2012-02-05 2013-08-08 Danillo Bracco Graziosi Method for generating high resolution depth images from low resolution depth images using edge information
US9830714B2 (en) * 2014-06-27 2017-11-28 Samsung Electronics Co., Ltd. Graphics processing with advection to reconstruct missing sample data points
US9904971B2 (en) * 2014-06-27 2018-02-27 Samsung Electronics Co., Ltd. Adaptive desampling in a graphics system with composited level of detail map
US10531040B2 (en) * 2015-03-30 2020-01-07 Sony Corporation Information processing device and information processing method to improve image quality on a large screen
US10043281B2 (en) * 2015-06-14 2018-08-07 Sony Interactive Entertainment Inc. Apparatus and method for estimating eye gaze location
US20160379400A1 (en) * 2015-06-23 2016-12-29 Intel Corporation Three-Dimensional Renderer
US10330935B2 (en) * 2016-09-22 2019-06-25 Apple Inc. Predictive, foveated virtual reality system
US10043318B2 (en) * 2016-12-09 2018-08-07 Qualcomm Incorporated Display synchronized image warping
US20180165799A1 (en) * 2016-12-12 2018-06-14 Daniel Pohl Screen matrix rendering in head mounted displays
US10152822B2 (en) * 2017-04-01 2018-12-11 Intel Corporation Motion biased foveated renderer

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102342102A (zh) * 2008-12-31 2012-02-01 先进微装置公司 具有先进的空间过滤差动矢量的多候选运动估计
CN102461150A (zh) * 2009-04-23 2012-05-16 想象技术有限公司 在运动估计系统中使用动量和加速度矢量的对象跟踪
CN103929568A (zh) * 2013-01-11 2014-07-16 索尼公司 用于稳定数字图像帧的第一序列的方法以及图像稳定单元
US9811914B2 (en) * 2013-06-17 2017-11-07 Immedia Semiconductor, Inc. Multi-window image processing and motion compensation
CN105225264A (zh) * 2014-06-27 2016-01-06 三星电子株式会社 基于运动的自适应渲染

Also Published As

Publication number Publication date
EP3714435A4 (en) 2021-08-11
US10169843B1 (en) 2019-01-01
JP2021503669A (ja) 2021-02-12
CN111373441A (zh) 2020-07-03
EP3714435B1 (en) 2024-04-10
KR20200078678A (ko) 2020-07-01
EP3714435A1 (en) 2020-09-30
KR102398599B1 (ko) 2022-05-16
WO2019099101A1 (en) 2019-05-23

Similar Documents

Publication Publication Date Title
CN111373441B (zh) 使用运动估计的随时间注视点渲染
Huang et al. Temporally coherent completion of dynamic video
US9153032B2 (en) Conversion method and apparatus with depth map generation
JP4740657B2 (ja) カラーセグメンテーションに基づくステレオ３次元再構成システムおよびプロセス
US8970580B2 (en) Method, apparatus and computer-readable medium rendering three-dimensional (3D) graphics
US11455712B2 (en) Method and apparatus for enhancing stereo vision
KR102350235B1 (ko) 영상 처리 방법 및 장치
US8204124B2 (en) Image processing apparatus, method thereof, and program
CN100499778C (zh) 用于使用迭代质心来估计摄像机模型参数的方法和装置
US10937195B2 (en) Label based approach for video encoding
JP6461209B2 (ja) ビデオ符号化システム及びビデオを符号化する方法
US20120176536A1 (en) Adaptive Frame Rate Conversion
US12132923B2 (en) Motion estimation using pixel activity metrics
CN101271580A (zh) 三维递归运动估测系统及其寻找方法
JP2013150094A (ja) タスクスケジューリング装置、タスクスケジューリング方法およびタスクスケジューリングプログラム
KR20170031480A (ko) 렌더링 장치 및 방법
US20230102620A1 (en) Variable rate rendering based on motion estimation
US9401038B2 (en) Information processing apparatus, generation method, and storage medium
JP2008521081A (ja) 画像セグメンテーションに基づく画像レンダリング
CN100541539C (zh) 用于执行隐藏面消除的设备和方法
US8571342B2 (en) Image processing and generation of focus information
AU5261899A (en) Segmenting moving objects and determining their motion
CN101304527A (zh) 三维递归运动估测系统及其寻找方法
TW201337834A (zh) 影像空洞填補方法、立體影像產生方法及其裝置

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant