JP7303783B2 - 不明のダウンスケーリングカーネルで生成された画像をアップスケールするための手法 - Google Patents

不明のダウンスケーリングカーネルで生成された画像をアップスケールするための手法 Download PDF

Info

Publication number
JP7303783B2
JP7303783B2 JP2020133682A JP2020133682A JP7303783B2 JP 7303783 B2 JP7303783 B2 JP 7303783B2 JP 2020133682 A JP2020133682 A JP 2020133682A JP 2020133682 A JP2020133682 A JP 2020133682A JP 7303783 B2 JP7303783 B2 JP 7303783B2
Authority
JP
Japan
Prior art keywords
image
kernel
scaling
generating
scaled
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
JP2020133682A
Other languages
English (en)
Japanese (ja)
Other versions
JP2021034038A (ja
JP2021034038A5 (enExample
Inventor
シュレールス クリストファー
ワン イーファン
コルニレール ヴィクトル
ソルキン－ホーナング オルガ
ジェロウア アブデルアジズ
Original Assignee
ディズニー エンタープライジーズ インコーポレイテッド
アイトゲノシシュ・テクニシェ・ホッホシューレ・チューリッヒ
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by ディズニー エンタープライジーズ インコーポレイテッド, アイトゲノシシュ・テクニシェ・ホッホシューレ・チューリッヒ filed Critical ディズニー エンタープライジーズ インコーポレイテッド
Publication of JP2021034038A publication Critical patent/JP2021034038A/ja
Publication of JP2021034038A5 publication Critical patent/JP2021034038A5/ja
Application granted granted Critical
Publication of JP7303783B2 publication Critical patent/JP7303783B2/ja
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00—Geometric image transformations in the plane of the image
    • G06T3/40—Scaling of whole images or parts thereof, e.g. expanding or contracting
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00—Geometric image transformations in the plane of the image
    • G06T3/40—Scaling of whole images or parts thereof, e.g. expanding or contracting
    • G06T3/4046—Scaling of whole images or parts thereof, e.g. expanding or contracting using neural networks
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G06N3/045—Combinations of networks
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T1/00—General purpose image data processing
    • G06T1/20—Processor architectures; Processor configuration, e.g. pipelining
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10016—Video; Image sequence
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20081—Training; Learning
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20084—Artificial neural networks [ANN]
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2211/00—Image generation
    • G06T2211/40—Computed tomography
    • G06T2211/416—Exact reconstruction

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Artificial Intelligence (AREA)
  • Evolutionary Computation (AREA)
  • Biomedical Technology (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Health & Medical Sciences (AREA)
  • Biophysics (AREA)
  • Computational Linguistics (AREA)
  • Data Mining & Analysis (AREA)
  • General Health & Medical Sciences (AREA)
  • Molecular Biology (AREA)
  • Computing Systems (AREA)
  • General Engineering & Computer Science (AREA)
  • Mathematical Physics (AREA)
  • Software Systems (AREA)
  • Image Processing (AREA)
JP2020133682A 2019-08-15 2020-08-06 不明のダウンスケーリングカーネルで生成された画像をアップスケールするための手法 Active JP7303783B2 (ja)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US16/542,227 2019-08-15
US16/542,227 US11080824B2 (en) 2019-08-15 2019-08-15 Techniques for upscaling images generated with undetermined downscaling kernels

Publications (3)

Publication Number Publication Date
JP2021034038A JP2021034038A (ja) 2021-03-01
JP2021034038A5 JP2021034038A5 (enExample) 2021-07-26
JP7303783B2 true JP7303783B2 (ja) 2023-07-05

Family

ID=71950572

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2020133682A Active JP7303783B2 (ja) 2019-08-15 2020-08-06 不明のダウンスケーリングカーネルで生成された画像をアップスケールするための手法

Country Status (4)

Country Link
US (1) US11080824B2 (enExample)
EP (1) EP3779863B1 (enExample)
JP (1) JP7303783B2 (enExample)
KR (1) KR102512507B1 (enExample)

Families Citing this family (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11126895B2 (en) * 2019-05-22 2021-09-21 Lawrence Livermore National Security, Llc Mimicking of corruption in images
US12217386B2 (en) * 2020-10-01 2025-02-04 Nvidia Corporation Image generation using one or more neural networks
US11769227B2 (en) * 2021-08-12 2023-09-26 Adobe Inc. Generating synthesized digital images utilizing a multi-resolution generator neural network
US12062152B2 (en) 2021-08-27 2024-08-13 Disney Enterprises, Inc. Re-noising and neural network based image enhancement
US12493927B2 (en) * 2021-09-30 2025-12-09 Baidu Usa Llc Robust and efficient blind super-resolution using variational kernel autoencoder
US20230144735A1 (en) * 2021-11-09 2023-05-11 Netflix, Inc. Techniques for jointly training a downscaler and an upscaler for video streaming

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10970819B2 (en) * 2017-05-26 2021-04-06 Rakuten, Inc. Image processing device, image processing method, and image processing program
US10885608B2 (en) * 2018-06-06 2021-01-05 Adobe Inc. Super-resolution with reference images
US11107205B2 (en) * 2019-02-18 2021-08-31 Samsung Electronics Co., Ltd. Techniques for convolutional neural network-based multi-exposure fusion of multiple image frames and for deblurring multiple image frames
US10977524B2 (en) * 2019-04-11 2021-04-13 Open Text Sa Ulc Classification with segmentation neural network for image-based content capture

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
Jinjin Gu 他，Blind Super-ResolutionWith Iterative Kernel Correction，2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) ，IEEE，2019年06月15日，p1604-1613

Also Published As

Publication number Publication date
JP2021034038A (ja) 2021-03-01
EP3779863B1 (en) 2022-04-27
KR102512507B1 (ko) 2023-03-22
EP3779863A1 (en) 2021-02-17
US20210049739A1 (en) 2021-02-18
KR20210021272A (ko) 2021-02-25
US11080824B2 (en) 2021-08-03

Similar Documents

Publication Publication Date Title
JP7303783B2 (ja) 不明のダウンスケーリングカーネルで生成された画像をアップスケールするための手法
CN113014927B (zh) 图像压缩方法和图像压缩装置
Lai et al. Deep laplacian pyramid networks for fast and accurate super-resolution
US10783611B2 (en) Frame-recurrent video super-resolution
CN114868401B (zh) 使用下采样/上采样和深度图非线性滤波对视频数据的编码方案
CN116681584A (zh) 一种多级扩散图像超分辨算法
KR102225024B1 (ko) 이미지 채움 장치 및 방법
EP3721628B1 (en) Processing signal data using an upsampling adjuster
US12211178B2 (en) Transferring faces between digital images by combining latent codes utilizing a blending network
CN118339577A (zh) 使用变分核自动编码器的鲁棒高效的盲超分辨率
US20220321830A1 (en) Optimization of adaptive convolutions for video frame interpolation
US11308361B1 (en) Checkerboard artifact free sub-pixel convolution
KR102353837B1 (ko) 고해상도 얼굴 영상 복원 방법 및 장치
CN115239591A (zh) 图像处理方法、装置、电子设备、存储介质及程序产品
US20230237628A1 (en) Modeling continuous kernels to generate an enhanced digital image from a burst of digital images
CN109447900A (zh) 一种图像超分辨率重建方法及装置
CN114008661A (zh) 图像处理方法、装置及其计算机程序产品
CN117952901A (zh) 基于生成对抗网络的多源异构图像变化检测方法及装置
CN116580269B (zh) 训练模型的方法、处理图像的方法、电子设备及存储介质
KR102244457B1 (ko) 시멘틱 구역화를 위한 상향샘플링 방법 및 시스템
CN117557452A (zh) 一种图像还原方法、装置、设备及存储介质
HK40048748B (zh) 人脸图像的修复方法与装置、修复模型、介质和设备
CN120912431A (zh) 结合空间变化特征的鱼眼畸变校正图像超分辨率方法
Brykin et al. ReactSR: Efficient Real-World Super-Resolution Application in a Single Floppy Disk

Legal Events

Date Code Title Description
A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20201026

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20210527

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20210527

A977 Report on retrieval

Free format text: JAPANESE INTERMEDIATE CODE: A971007

Effective date: 20220713

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20220720

A601 Written request for extension of time

Free format text: JAPANESE INTERMEDIATE CODE: A601

Effective date: 20221020

A601 Written request for extension of time

Free format text: JAPANESE INTERMEDIATE CODE: A601

Effective date: 20221220

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20230120

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20230524

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20230623

R150 Certificate of patent or registration of utility model

Ref document number: 7303783

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R150