KR102398599B1 - 모션 추정을 사용한 시간적 포비티드 렌더링 - Google Patents

모션 추정을 사용한 시간적 포비티드 렌더링 Download PDF

Info

Publication number
KR102398599B1
KR102398599B1 KR1020207017892A KR20207017892A KR102398599B1 KR 102398599 B1 KR102398599 B1 KR 102398599B1 KR 1020207017892 A KR1020207017892 A KR 1020207017892A KR 20207017892 A KR20207017892 A KR 20207017892A KR 102398599 B1 KR102398599 B1 KR 102398599B1
Authority
KR
South Korea
Prior art keywords
image
unit
rendered
pixels
motion vector
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
KR1020207017892A
Other languages
English (en)
Korean (ko)
Other versions
KR20200078678A (ko
Inventor
이합 아메르
구엔나디 리구어
루이진 우
스카일러 제이. 살레
보리스 이바노비치
가보 시네스
Original Assignee
어드밴스드 마이크로 디바이시즈, 인코포레이티드
에이티아이 테크놀로지스 유엘씨
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 어드밴스드 마이크로 디바이시즈, 인코포레이티드, 에이티아이 테크놀로지스 유엘씨 filed Critical 어드밴스드 마이크로 디바이시즈, 인코포레이티드
Publication of KR20200078678A publication Critical patent/KR20200078678A/ko
Application granted granted Critical
Publication of KR102398599B1 publication Critical patent/KR102398599B1/ko
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/00—Three-dimensional [3D] image rendering
    • G06T15/10—Geometric effects
    • G06T15/20—Perspective computation
    • G06T15/205—Image-based rendering
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00—Geometric image transformations in the plane of the image
    • G06T3/40—Scaling of whole images or parts thereof, e.g. expanding or contracting
    • G06T3/403—Edge-driven scaling; Edge-based scaling
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/20—Analysis of motion
    • G06T7/223—Analysis of motion using block-matching
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/00—Three-dimensional [3D] image rendering
    • G06T15/005—General purpose rendering architectures
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00—Image enhancement or restoration
    • G06T5/50—Image enhancement or restoration using two or more images, e.g. averaging or subtraction
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00—Image enhancement or restoration
    • G06T5/77—Retouching; Inpainting; Scratch removal
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/10—Segmentation; Edge detection
    • G06T7/13—Edge detection
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/10—Segmentation; Edge detection
    • G06T7/136—Segmentation; Edge detection involving thresholding
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/20—Analysis of motion
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/20—Analysis of motion
    • G06T7/246—Analysis of motion using feature-based methods, e.g. the tracking of corners or segments
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/20—Analysis of motion
    • G06T7/246—Analysis of motion using feature-based methods, e.g. the tracking of corners or segments
    • G06T7/248—Analysis of motion using feature-based methods, e.g. the tracking of corners or segments involving reference images or patches
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10016—Video; Image sequence
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20021—Dividing image into blocks, subimages or windows
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2210/00—Indexing scheme for image generation or computer graphics
    • G06T2210/08—Bandwidth reduction

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Multimedia (AREA)
  • Computer Graphics (AREA)
  • Computing Systems (AREA)
  • Geometry (AREA)
  • Image Analysis (AREA)
  • Television Systems (AREA)
KR1020207017892A 2017-11-20 2018-09-19 모션 추정을 사용한 시간적 포비티드 렌더링 Active KR102398599B1 (ko)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US15/818,072 2017-11-20
US15/818,072 US10169843B1 (en) 2017-11-20 2017-11-20 Temporal foveated rendering using motion estimation
PCT/US2018/051732 WO2019099101A1 (en) 2017-11-20 2018-09-19 Temporal foveated rendering using motion estimation

Publications (2)

Publication Number Publication Date
KR20200078678A KR20200078678A (ko) 2020-07-01
KR102398599B1 true KR102398599B1 (ko) 2022-05-16

Family

ID=64739845

Family Applications (1)

Application Number Title Priority Date Filing Date
KR1020207017892A Active KR102398599B1 (ko) 2017-11-20 2018-09-19 모션 추정을 사용한 시간적 포비티드 렌더링

Country Status (6)

Country Link
US (1) US10169843B1 (https=)
EP (1) EP3714435B1 (https=)
JP (1) JP2021503669A (https=)
KR (1) KR102398599B1 (https=)
CN (1) CN111373441B (https=)
WO (1) WO2019099101A1 (https=)

Families Citing this family (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11611773B2 (en) * 2018-04-06 2023-03-21 Qatar Foundation For Education, Science And Community Development System of video steganalysis and a method for the detection of covert communications
US11381825B2 (en) 2018-11-27 2022-07-05 Advanced Micro Devices, Inc. Variable rate rendering based on motion estimation
KR102837402B1 (ko) 2019-07-28 2025-07-23 구글 엘엘씨 포비에이티드 메시들로 몰입형 비디오 콘텐츠를 렌더링하기 위한 방법들, 시스템들, 및 매체들
US11363247B2 (en) * 2020-02-14 2022-06-14 Valve Corporation Motion smoothing in a distributed system
US11361545B1 (en) * 2020-11-20 2022-06-14 Himax Technologies Limited Monitoring device for detecting object of interest and operation method thereof
CN114786051B (zh) * 2022-03-31 2023-04-14 北京百度网讯科技有限公司 一种视频渲染方法、装置、电子设备及存储介质
US12488769B2 (en) * 2023-03-30 2025-12-02 Apple Inc. Content based foveation

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20180286105A1 (en) 2017-04-01 2018-10-04 Intel Corporation Motion biased foveated renderer

Family Cites Families (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9384564B2 (en) * 2007-11-19 2016-07-05 Microsoft Technology Licensing, Llc Rendering of data sets comprising multiple-resolution samples
US20100166073A1 (en) * 2008-12-31 2010-07-01 Advanced Micro Devices, Inc. Multiple-Candidate Motion Estimation With Advanced Spatial Filtering of Differential Motion Vectors
GB2469679B (en) * 2009-04-23 2012-05-02 Imagination Tech Ltd Object tracking using momentum and acceleration vectors in a motion estimation system
US9897805B2 (en) * 2013-06-07 2018-02-20 Sony Interactive Entertainment Inc. Image rendering responsive to user actions in head mounted display
US20130202194A1 (en) * 2012-02-05 2013-08-08 Danillo Bracco Graziosi Method for generating high resolution depth images from low resolution depth images using edge information
US9712818B2 (en) * 2013-01-11 2017-07-18 Sony Corporation Method for stabilizing a first sequence of digital image frames and image stabilization unit
US9984472B2 (en) * 2013-06-17 2018-05-29 A9.Com, Inc. Image processing and motion compensation
CN105225264B (zh) * 2014-06-27 2020-11-10 三星电子株式会社 基于运动的自适应渲染
US9830714B2 (en) * 2014-06-27 2017-11-28 Samsung Electronics Co., Ltd. Graphics processing with advection to reconstruct missing sample data points
US9904971B2 (en) * 2014-06-27 2018-02-27 Samsung Electronics Co., Ltd. Adaptive desampling in a graphics system with composited level of detail map
US10531040B2 (en) * 2015-03-30 2020-01-07 Sony Corporation Information processing device and information processing method to improve image quality on a large screen
US10043281B2 (en) * 2015-06-14 2018-08-07 Sony Interactive Entertainment Inc. Apparatus and method for estimating eye gaze location
US20160379400A1 (en) * 2015-06-23 2016-12-29 Intel Corporation Three-Dimensional Renderer
US10330935B2 (en) * 2016-09-22 2019-06-25 Apple Inc. Predictive, foveated virtual reality system
US10043318B2 (en) * 2016-12-09 2018-08-07 Qualcomm Incorporated Display synchronized image warping
US20180165799A1 (en) * 2016-12-12 2018-06-14 Daniel Pohl Screen matrix rendering in head mounted displays

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20180286105A1 (en) 2017-04-01 2018-10-04 Intel Corporation Motion biased foveated renderer

Also Published As

Publication number Publication date
EP3714435A4 (en) 2021-08-11
US10169843B1 (en) 2019-01-01
JP2021503669A (ja) 2021-02-12
CN111373441B (zh) 2022-06-03
CN111373441A (zh) 2020-07-03
EP3714435B1 (en) 2024-04-10
KR20200078678A (ko) 2020-07-01
EP3714435A1 (en) 2020-09-30
WO2019099101A1 (en) 2019-05-23

Similar Documents

Publication Publication Date Title
KR102398599B1 (ko) 모션 추정을 사용한 시간적 포비티드 렌더링
US10818018B2 (en) Image processing apparatus, image processing method, and non-transitory computer-readable storage medium
CN102771110B (zh) 运动估计系统中使用图形引擎获取的矢量的对象跟踪
CN106254885B (zh) 数据处理系统、执行运动估计的方法
US8761509B1 (en) Method and apparatus for fast computational stereo
JP2006012166A (ja) カラーセグメンテーションに基づくステレオ３次元再構成システムおよびプロセス
KR101855980B1 (ko) 홀 채우기 방법 및 장치
KR101632992B1 (ko) 깊이 와핑에 기반한 폐색 컬링을 위한 방법, 장치 및 컴퓨터 판독 가능한 기록 매체
GB2476143A (en) Frame rate conversion using bi-directional, local and global motion estimation
KR20120041464A (ko) 다시점 비디오로부터 일관성 있는 변이를 추정하는 변이 추정 시스템 및 방법
KR20150146419A (ko) 시간적으로 일관된 수퍼픽셀들을 생성하기 위한 방법 및 장치
US10937195B2 (en) Label based approach for video encoding
JP2006516062A (ja) ディジタル画像の奥行き順序付けを行う方法及び装置
US9420306B2 (en) Estimating method of predicted motion vector
US20120176536A1 (en) Adaptive Frame Rate Conversion
CN112001949B (zh) 确定目标点移动速度的方法、装置、可读存储介质及设备
CN101271580A (zh) 三维递归运动估测系统及其寻找方法
US12132923B2 (en) Motion estimation using pixel activity metrics
JP2010108205A (ja) 超解像画像作成方法
WO2012066866A1 (ja) 動きベクトル検出装置、動きベクトル検出方法、フレーム補間装置及びフレーム補間方法
US20230102620A1 (en) Variable rate rendering based on motion estimation
KR100969420B1 (ko) 프레임 레이트 변환 방법
JP2006521740A (ja) 動きベクトル決定方法
JP4606736B2 (ja) 特徴点選択
JP6854629B2 (ja) 画像処理装置、画像処理方法

Legal Events

Date Code Title Description
PA0105 International application

Patent event date: 20200619

Patent event code: PA01051R01D

Comment text: International Patent Application

PG1501 Laying open of application
A201 Request for examination
A302 Request for accelerated examination
PA0201 Request for examination

Patent event code: PA02012R01D

Patent event date: 20210923

Comment text: Request for Examination of Application

PA0302 Request for accelerated examination

Patent event date: 20210923

Patent event code: PA03022R01D

Comment text: Request for Accelerated Examination

E902 Notification of reason for refusal
PE0902 Notice of grounds for rejection

Comment text: Notification of reason for refusal

Patent event date: 20211013

Patent event code: PE09021S01D

E701 Decision to grant or registration of patent right
PE0701 Decision of registration

Patent event code: PE07011S01D

Comment text: Decision to Grant Registration

Patent event date: 20220225

GRNT Written decision to grant
PR0701 Registration of establishment

Comment text: Registration of Establishment

Patent event date: 20220511

Patent event code: PR07011E01D

PR1002 Payment of registration fee

Payment date: 20220512

End annual number: 3

Start annual number: 1

PG1601 Publication of registration
PR1001 Payment of annual fee

Payment date: 20250507

Start annual number: 4

End annual number: 4