JP2021503669A - 動き推定を用いた一時的な穴のあるレンダリング - Google Patents

動き推定を用いた一時的な穴のあるレンダリング Download PDF

Info

Publication number
JP2021503669A
JP2021503669A JP2020527885A JP2020527885A JP2021503669A JP 2021503669 A JP2021503669 A JP 2021503669A JP 2020527885 A JP2020527885 A JP 2020527885A JP 2020527885 A JP2020527885 A JP 2020527885A JP 2021503669 A JP2021503669 A JP 2021503669A
Authority
JP
Japan
Prior art keywords
image
pixels
motion vector
unit
unrendered
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
JP2020527885A
Other languages
English (en)
Japanese (ja)
Other versions
JP2021503669A5 (https=
Inventor
アメール イハブ
アメール イハブ
リグール グエンナディ
リグール グエンナディ
ウー ルイジン
ウー ルイジン
ジェイ． サレハ スカイラー
ジェイ． サレハ スカイラー
イバノビッチ ボリス
イバノビッチ ボリス
シネス ガボール
シネス ガボール
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
ATI Technologies ULC
Advanced Micro Devices Inc
Original Assignee
ATI Technologies ULC
Advanced Micro Devices Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by ATI Technologies ULC, Advanced Micro Devices Inc filed Critical ATI Technologies ULC
Publication of JP2021503669A publication Critical patent/JP2021503669A/ja
Publication of JP2021503669A5 publication Critical patent/JP2021503669A5/ja
Pending legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00—Geometric image transformations in the plane of the image
    • G06T3/40—Scaling of whole images or parts thereof, e.g. expanding or contracting
    • G06T3/403—Edge-driven scaling; Edge-based scaling
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/00—Three-dimensional [3D] image rendering
    • G06T15/10—Geometric effects
    • G06T15/20—Perspective computation
    • G06T15/205—Image-based rendering
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/20—Analysis of motion
    • G06T7/223—Analysis of motion using block-matching
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/00—Three-dimensional [3D] image rendering
    • G06T15/005—General purpose rendering architectures
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00—Image enhancement or restoration
    • G06T5/50—Image enhancement or restoration using two or more images, e.g. averaging or subtraction
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00—Image enhancement or restoration
    • G06T5/77—Retouching; Inpainting; Scratch removal
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/10—Segmentation; Edge detection
    • G06T7/13—Edge detection
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/10—Segmentation; Edge detection
    • G06T7/136—Segmentation; Edge detection involving thresholding
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/20—Analysis of motion
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/20—Analysis of motion
    • G06T7/246—Analysis of motion using feature-based methods, e.g. the tracking of corners or segments
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/20—Analysis of motion
    • G06T7/246—Analysis of motion using feature-based methods, e.g. the tracking of corners or segments
    • G06T7/248—Analysis of motion using feature-based methods, e.g. the tracking of corners or segments involving reference images or patches
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10016—Video; Image sequence
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20021—Dividing image into blocks, subimages or windows
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2210/00—Indexing scheme for image generation or computer graphics
    • G06T2210/08—Bandwidth reduction

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Multimedia (AREA)
  • Computer Graphics (AREA)
  • Computing Systems (AREA)
  • Geometry (AREA)
  • Image Analysis (AREA)
  • Television Systems (AREA)
JP2020527885A 2017-11-20 2018-09-19 動き推定を用いた一時的な穴のあるレンダリング Pending JP2021503669A (ja)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US15/818,072 2017-11-20
US15/818,072 US10169843B1 (en) 2017-11-20 2017-11-20 Temporal foveated rendering using motion estimation
PCT/US2018/051732 WO2019099101A1 (en) 2017-11-20 2018-09-19 Temporal foveated rendering using motion estimation

Publications (2)

Publication Number Publication Date
JP2021503669A true JP2021503669A (ja) 2021-02-12
JP2021503669A5 JP2021503669A5 (https=) 2021-11-04

Family

ID=64739845

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2020527885A Pending JP2021503669A (ja) 2017-11-20 2018-09-19 動き推定を用いた一時的な穴のあるレンダリング

Country Status (6)

Country Link
US (1) US10169843B1 (https=)
EP (1) EP3714435B1 (https=)
JP (1) JP2021503669A (https=)
KR (1) KR102398599B1 (https=)
CN (1) CN111373441B (https=)
WO (1) WO2019099101A1 (https=)

Families Citing this family (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11611773B2 (en) * 2018-04-06 2023-03-21 Qatar Foundation For Education, Science And Community Development System of video steganalysis and a method for the detection of covert communications
US11381825B2 (en) 2018-11-27 2022-07-05 Advanced Micro Devices, Inc. Variable rate rendering based on motion estimation
KR102837402B1 (ko) 2019-07-28 2025-07-23 구글 엘엘씨 포비에이티드 메시들로 몰입형 비디오 콘텐츠를 렌더링하기 위한 방법들, 시스템들, 및 매체들
US11363247B2 (en) * 2020-02-14 2022-06-14 Valve Corporation Motion smoothing in a distributed system
US11361545B1 (en) * 2020-11-20 2022-06-14 Himax Technologies Limited Monitoring device for detecting object of interest and operation method thereof
CN114786051B (zh) * 2022-03-31 2023-04-14 北京百度网讯科技有限公司 一种视频渲染方法、装置、电子设备及存储介质
US12488769B2 (en) * 2023-03-30 2025-12-02 Apple Inc. Content based foveation

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2012525042A (ja) * 2009-04-23 2012-10-18 イマジネイション テクノロジーズ リミテッド 動き推定システムにおいてモーメント及び加速度ベクトルを使用するオブジェクト追跡
JP2016012354A (ja) * 2014-06-27 2016-01-21 三星電子株式会社Ｓａｍｓｕｎｇ Ｅｌｅｃｔｒｏｎｉｃｓ Ｃｏ．，Ｌｔｄ． 適応的レンダリングを行う方法及びグラフィックスシステム

Family Cites Families (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9384564B2 (en) * 2007-11-19 2016-07-05 Microsoft Technology Licensing, Llc Rendering of data sets comprising multiple-resolution samples
US20100166073A1 (en) * 2008-12-31 2010-07-01 Advanced Micro Devices, Inc. Multiple-Candidate Motion Estimation With Advanced Spatial Filtering of Differential Motion Vectors
US9897805B2 (en) * 2013-06-07 2018-02-20 Sony Interactive Entertainment Inc. Image rendering responsive to user actions in head mounted display
US20130202194A1 (en) * 2012-02-05 2013-08-08 Danillo Bracco Graziosi Method for generating high resolution depth images from low resolution depth images using edge information
US9712818B2 (en) * 2013-01-11 2017-07-18 Sony Corporation Method for stabilizing a first sequence of digital image frames and image stabilization unit
US9984472B2 (en) * 2013-06-17 2018-05-29 A9.Com, Inc. Image processing and motion compensation
CN105225264B (zh) * 2014-06-27 2020-11-10 三星电子株式会社 基于运动的自适应渲染
US9904971B2 (en) * 2014-06-27 2018-02-27 Samsung Electronics Co., Ltd. Adaptive desampling in a graphics system with composited level of detail map
US10531040B2 (en) * 2015-03-30 2020-01-07 Sony Corporation Information processing device and information processing method to improve image quality on a large screen
US10043281B2 (en) * 2015-06-14 2018-08-07 Sony Interactive Entertainment Inc. Apparatus and method for estimating eye gaze location
US20160379400A1 (en) * 2015-06-23 2016-12-29 Intel Corporation Three-Dimensional Renderer
US10330935B2 (en) * 2016-09-22 2019-06-25 Apple Inc. Predictive, foveated virtual reality system
US10043318B2 (en) * 2016-12-09 2018-08-07 Qualcomm Incorporated Display synchronized image warping
US20180165799A1 (en) * 2016-12-12 2018-06-14 Daniel Pohl Screen matrix rendering in head mounted displays
US10152822B2 (en) * 2017-04-01 2018-12-11 Intel Corporation Motion biased foveated renderer

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2012525042A (ja) * 2009-04-23 2012-10-18 イマジネイション テクノロジーズ リミテッド 動き推定システムにおいてモーメント及び加速度ベクトルを使用するオブジェクト追跡
JP2016012354A (ja) * 2014-06-27 2016-01-21 三星電子株式会社Ｓａｍｓｕｎｇ Ｅｌｅｃｔｒｏｎｉｃｓ Ｃｏ．，Ｌｔｄ． 適応的レンダリングを行う方法及びグラフィックスシステム

Also Published As

Publication number Publication date
EP3714435A4 (en) 2021-08-11
US10169843B1 (en) 2019-01-01
CN111373441B (zh) 2022-06-03
CN111373441A (zh) 2020-07-03
EP3714435B1 (en) 2024-04-10
KR20200078678A (ko) 2020-07-01
EP3714435A1 (en) 2020-09-30
KR102398599B1 (ko) 2022-05-16
WO2019099101A1 (en) 2019-05-23

Similar Documents

Publication Publication Date Title
JP2021503669A (ja) 動き推定を用いた一時的な穴のあるレンダリング
US12243156B2 (en) Graphics processing using directional representations of lighting at probe positions within a scene
US8866821B2 (en) Depth map movement tracking via optical flow and velocity prediction
US8970580B2 (en) Method, apparatus and computer-readable medium rendering three-dimensional (3D) graphics
CN105405103B (zh) 通过在空间上和/或在时间上改变采样模式增强抗锯齿
US8873846B2 (en) Detecting and tracking point features with primary colors
JP7032871B2 (ja) 画像処理装置及び画像処理方法、プログラム、記憶媒体
US20180005039A1 (en) Method and apparatus for generating an initial superpixel label map for an image
KR20170034727A (ko) 그림자 정보 저장 방법 및 장치, 3d 렌더링 방법 및 장치
US9317928B2 (en) Detecting and tracking point features with primary colors
JP2010507865A (ja) ２次元画像から３次元パーティクル・システムを復元するためのシステムおよび方法
KR20160017517A (ko) 영상 처리 방법 및 장치
Mahmoudi et al. Multi-gpu based event detection and localization using high definition videos
KR102158390B1 (ko) 영상 처리 방법 및 장치
US12132923B2 (en) Motion estimation using pixel activity metrics
US20230102620A1 (en) Variable rate rendering based on motion estimation
KR101682137B1 (ko) 텍스처 및 움직임 감지를 사용한 시간적으로-일관된 변이 추정을 위한 방법 및 장치
Somraj et al. Temporal view synthesis of dynamic scenes through 3D object motion estimation with multi-plane images
JP7845570B2 (ja) 処理装置、処理方法、及び処理プログラム
US12100089B1 (en) Systems and methods for generating and animating three-dimensional assets with a dynamic resolution
Lee et al. Real-time Object Segmentation based on GPU

Legal Events

Date Code Title Description
A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20200729

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20210917

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20210917

A871 Explanation of circumstances concerning accelerated examination

Free format text: JAPANESE INTERMEDIATE CODE: A871

Effective date: 20210917

A977 Report on retrieval

Free format text: JAPANESE INTERMEDIATE CODE: A971007

Effective date: 20220120

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20220215

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20220516

A02 Decision of refusal

Free format text: JAPANESE INTERMEDIATE CODE: A02

Effective date: 20220726

C60 Trial request (containing other claim documents, opposition documents)

Free format text: JAPANESE INTERMEDIATE CODE: C60

Effective date: 20221125

C22 Notice of designation (change) of administrative judge

Free format text: JAPANESE INTERMEDIATE CODE: C22

Effective date: 20230104

C22 Notice of designation (change) of administrative judge

Free format text: JAPANESE INTERMEDIATE CODE: C22

Effective date: 20230221

C13 Notice of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: C13

Effective date: 20230307

A601 Written request for extension of time

Free format text: JAPANESE INTERMEDIATE CODE: A601

Effective date: 20230607

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20230628

A601 Written request for extension of time

Free format text: JAPANESE INTERMEDIATE CODE: A601

Effective date: 20231101

A601 Written request for extension of time

Free format text: JAPANESE INTERMEDIATE CODE: A601

Effective date: 20231201

A601 Written request for extension of time

Free format text: JAPANESE INTERMEDIATE CODE: A601

Effective date: 20240104