JP7260243B2 - ノイジーな画像をアップスケーリングする方法、及びノイジーな画像をアップスケーリングする装置 - Google Patents

ノイジーな画像をアップスケーリングする方法、及びノイジーな画像をアップスケーリングする装置 Download PDF

Info

Publication number
JP7260243B2
JP7260243B2 JP2016217107A JP2016217107A JP7260243B2 JP 7260243 B2 JP7260243 B2 JP 7260243B2 JP 2016217107 A JP2016217107 A JP 2016217107A JP 2016217107 A JP2016217107 A JP 2016217107A JP 7260243 B2 JP7260243 B2 JP 7260243B2
Authority
JP
Japan
Prior art keywords
image
filtering
applying
upscaling
output
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
JP2016217107A
Other languages
English (en)
Japanese (ja)
Other versions
JP2017091529A5 (enExample
JP2017091529A (ja
Inventor
コスーリー,マンゲッシュ
マルクス,ジョルディ サルバドール
Original Assignee
インターデジタル マディソン パテント ホールディングス, エスアーエス
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by インターデジタル マディソン パテント ホールディングス, エスアーエス filed Critical インターデジタル マディソン パテント ホールディングス, エスアーエス
Publication of JP2017091529A publication Critical patent/JP2017091529A/ja
Publication of JP2017091529A5 publication Critical patent/JP2017091529A5/ja
Application granted granted Critical
Publication of JP7260243B2 publication Critical patent/JP7260243B2/ja
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00Geometric image transformations in the plane of the image
    • G06T3/40Scaling of whole images or parts thereof, e.g. expanding or contracting
    • G06T3/4053Scaling of whole images or parts thereof, e.g. expanding or contracting based on super-resolution, i.e. the output image resolution being higher than the sensor resolution
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00Geometric image transformations in the plane of the image
    • G06T3/40Scaling of whole images or parts thereof, e.g. expanding or contracting
    • G06T3/4007Scaling of whole images or parts thereof, e.g. expanding or contracting based on interpolation, e.g. bilinear interpolation
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00Geometric image transformations in the plane of the image
    • G06T3/40Scaling of whole images or parts thereof, e.g. expanding or contracting
    • G06T3/4053Scaling of whole images or parts thereof, e.g. expanding or contracting based on super-resolution, i.e. the output image resolution being higher than the sensor resolution
    • G06T3/4076Scaling of whole images or parts thereof, e.g. expanding or contracting based on super-resolution, i.e. the output image resolution being higher than the sensor resolution using the original low-resolution images to iteratively correct the high-resolution images
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00Geometric image transformations in the plane of the image
    • G06T3/40Scaling of whole images or parts thereof, e.g. expanding or contracting
    • G06T3/4046Scaling of whole images or parts thereof, e.g. expanding or contracting using neural networks
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00Image enhancement or restoration
    • G06T5/50Image enhancement or restoration using two or more images, e.g. averaging or subtraction
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00Image enhancement or restoration
    • G06T5/60Image enhancement or restoration using machine learning, e.g. neural networks
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00Image enhancement or restoration
    • G06T5/70Denoising; Smoothing
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/20Special algorithmic details
    • G06T2207/20016Hierarchical, coarse-to-fine, multiscale or multiresolution image processing; Pyramid transform
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/20Special algorithmic details
    • G06T2207/20021Dividing image into blocks, subimages or windows
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/20Special algorithmic details
    • G06T2207/20024Filtering details
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/20Special algorithmic details
    • G06T2207/20081Training; Learning
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/20Special algorithmic details
    • G06T2207/20084Artificial neural networks [ANN]
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/20Special algorithmic details
    • G06T2207/20212Image combination
    • G06T2207/20221Image fusion; Image merging

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Artificial Intelligence (AREA)
  • Evolutionary Computation (AREA)
  • Image Processing (AREA)
  • Facsimile Image Signal Circuits (AREA)
  • Ultra Sonic Daignosis Equipment (AREA)
  • Closed-Circuit Television Systems (AREA)
JP2016217107A 2015-11-09 2016-11-07 ノイジーな画像をアップスケーリングする方法、及びノイジーな画像をアップスケーリングする装置 Active JP7260243B2 (ja)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
EP15306776.4 2015-11-09
EP15306776.4A EP3166070B1 (en) 2015-11-09 2015-11-09 Method for upscaling noisy images, and apparatus for upscaling noisy images

Publications (3)

Publication Number Publication Date
JP2017091529A JP2017091529A (ja) 2017-05-25
JP2017091529A5 JP2017091529A5 (enExample) 2019-12-19
JP7260243B2 true JP7260243B2 (ja) 2023-04-18

Family

ID=54703912

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2016217107A Active JP7260243B2 (ja) 2015-11-09 2016-11-07 ノイジーな画像をアップスケーリングする方法、及びノイジーな画像をアップスケーリングする装置

Country Status (5)

Country Link
US (1) US10319075B2 (enExample)
EP (1) EP3166070B1 (enExample)
JP (1) JP7260243B2 (enExample)
KR (1) KR102620105B1 (enExample)
CN (1) CN107016642B (enExample)

Families Citing this family (21)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2016132152A1 (en) 2015-02-19 2016-08-25 Magic Pony Technology Limited Interpolating visual data
EP3278559B1 (en) 2015-03-31 2021-05-05 Magic Pony Technology Limited Training end-to-end video processes
GB201604672D0 (en) * 2016-03-18 2016-05-04 Magic Pony Technology Ltd Generative methods of super resolution
EP3336757A1 (en) * 2016-12-16 2018-06-20 Tata Consultancy Services Limited Method and system for container code recognition
KR102326165B1 (ko) * 2017-08-23 2021-11-16 엘지디스플레이 주식회사 영상 처리 방법 및 이를 이용한 표시 장치
CN107767343B (zh) * 2017-11-09 2021-08-31 京东方科技集团股份有限公司 图像处理方法、处理装置和处理设备
KR101987079B1 (ko) * 2017-12-28 2019-06-10 주식회사 홈초이스 머신러닝 기반의 동적 파라미터에 의한 업스케일된 동영상의 노이즈 제거방법
KR101894278B1 (ko) 2018-01-18 2018-09-04 주식회사 뷰노 일련의 슬라이스 영상을 재구성하는 방법 및 이를 이용한 장치
WO2019178133A1 (en) * 2018-03-12 2019-09-19 Lvis Corporation Systems and methods for generating thin image slices from thick image slices
CN110300301B (zh) * 2018-03-22 2023-01-13 华为技术有限公司 图像编解码方法和装置
KR102570562B1 (ko) * 2018-07-16 2023-08-24 삼성전자주식회사 영상 처리 장치 및 그 동작방법
JP2020017229A (ja) * 2018-07-27 2020-01-30 国立大学法人 東京大学 画像処理装置、画像処理方法及び画像処理プログラム
US10931853B2 (en) * 2018-10-18 2021-02-23 Sony Corporation Enhanced color reproduction for upscaling
KR102604016B1 (ko) * 2018-10-24 2023-11-22 삼성전자주식회사 전자 장치 및 이의 제어방법
KR102098375B1 (ko) 2018-11-15 2020-04-08 충남대학교산학협력단 Jpeg 압축 이미지의 해상도 증가 시스템 및 그 방법
KR102184763B1 (ko) * 2019-02-08 2020-11-30 금오공과대학교 산학협력단 신경망이 적용된 통신 시스템 및 방법
WO2021226601A1 (en) * 2020-05-08 2021-11-11 Lets Enhance Inc Image enhancement
US11222406B2 (en) 2020-06-05 2022-01-11 Canon Medical Systems Corporation Method and system for training a machine learning-based image denoising system
CN112734646B (zh) * 2021-01-19 2024-02-02 青岛大学 一种基于特征通道划分的图像超分辨率重建方法
WO2022197001A1 (en) 2021-03-16 2022-09-22 +Samsung Electronics Co., Ltd. Method and electronic device for removing artifact in high resolution image
KR20240007420A (ko) 2022-07-08 2024-01-16 한화비전 주식회사 머신 러닝을 이용한 영상 노이즈 학습 서버 및 영상 노이즈 저감 장치

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2015129987A (ja) 2014-01-06 2015-07-16 国立大学法人三重大学 医用高解像画像形成システムおよび方法。

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20070083114A1 (en) * 2005-08-26 2007-04-12 The University Of Connecticut Systems and methods for image resolution enhancement
US8867858B2 (en) * 2010-01-28 2014-10-21 Yissum Research Development Company Of The Hebrew University Of Jerusalem, Ltd. Method and system for generating an output image of increased pixel resolution from an input image
US20120044389A1 (en) * 2010-08-20 2012-02-23 Altek Corporation Method for generating super resolution image
US8655109B2 (en) * 2011-08-05 2014-02-18 Adobe Systems Incorporated Regression-based learning model for image upscaling
EP2615579A1 (en) * 2012-01-12 2013-07-17 Thomson Licensing Method and device for generating a super-resolution version of a low resolution input data structure
CN103390266B (zh) * 2013-07-31 2016-05-18 广东威创视讯科技股份有限公司 一种图像超分辨率方法和装置
EP2908285A1 (en) 2014-02-13 2015-08-19 Thomson Licensing Method for performing super-resolution on single images and apparatus for performing super-resolution on single images

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2015129987A (ja) 2014-01-06 2015-07-16 国立大学法人三重大学 医用高解像画像形成システムおよび方法。

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
Abhishek Singh, et al,Super-Resolving Noisy Images,Conference on Computer Vision and Pattern Recognition,米国,IEEE,2014年06月23日,2846-2853,https://ieeexplore.ieee.org/document/6909760

Also Published As

Publication number Publication date
CN107016642A (zh) 2017-08-04
KR102620105B1 (ko) 2024-01-03
EP3166070A1 (en) 2017-05-10
EP3166070B1 (en) 2021-01-06
US10319075B2 (en) 2019-06-11
CN107016642B (zh) 2022-08-16
KR20170058277A (ko) 2017-05-26
US20170132760A1 (en) 2017-05-11
JP2017091529A (ja) 2017-05-25

Similar Documents

Publication Publication Date Title
JP7260243B2 (ja) ノイジーな画像をアップスケーリングする方法、及びノイジーな画像をアップスケーリングする装置
Deng et al. Hessian matrix-based fourth-order anisotropic diffusion filter for image denoising
Liu et al. A medical image enhancement method using adaptive thresholding in NSCT domain combined unsharp masking
CN104992415B (zh) 一种基于全变差和小波变换的图像去噪方法及系统
CN107784638A (zh) 一种优化的东巴古籍图像增强方法
CN103093433A (zh) 基于区域划分和字典学习的自然图像去噪方法
CN103077508A (zh) 基于变换域非局部和最小均方误差的sar图像去噪方法
Wang et al. New image restoration method associated with tetrolets shrinkage and weighted anisotropic total variation
CN106570843A (zh) 一种自适应小波阈值函数图像噪声抑制方法
CN110322404B (zh) 一种图像增强方法及系统
Jalab et al. Fractional conway polynomials for image denoising with regularized fractional power parameters
CN105023257B (zh) 基于N‑Smoothlets的图像去噪方法
CN106920223A (zh) 一种小波和有理数阶偏微分联合图像增强方法
Naveen et al. Image denoising by Fourier block processing and Wiener filtering
Ram et al. Image super-resolution using graph regularized block sparse representation
CN106327440B (zh) 含有非局域数据保真项的图像分解滤波方法
Zhang et al. Hybrid gradient-domain image denoising
Unni et al. Non-Local Patch-Based Regularization for Image Restoration
CN111626966A (zh) 声呐图像的去噪模型训练方法及其装置和可读存储介质
Shin et al. Image denoiser using convolutional neural network with deconvolution and modified residual network
Shanmugasundaram et al. A Novel Image Restoration Algorithm Using NSCT and Pixel Level Fusion.
Fahmy et al. E-spline based image interpolators
Majeeth et al. A Novel Algorithm to Remove Gaussian Noise in an Image
Song et al. Image denoising method based on non-uniform partition and wavelet transform
Dhiman et al. An improved threshold estimation technique for image denoising using wavelet thresholding techniques

Legal Events

Date Code Title Description
RD03 Notification of appointment of power of attorney

Free format text: JAPANESE INTERMEDIATE CODE: A7423

Effective date: 20181220

RD04 Notification of resignation of power of attorney

Free format text: JAPANESE INTERMEDIATE CODE: A7424

Effective date: 20181227

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20191106

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20191106

A711 Notification of change in applicant

Free format text: JAPANESE INTERMEDIATE CODE: A711

Effective date: 20191111

A711 Notification of change in applicant

Free format text: JAPANESE INTERMEDIATE CODE: A711

Effective date: 20201217

A977 Report on retrieval

Free format text: JAPANESE INTERMEDIATE CODE: A971007

Effective date: 20201228

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20210318

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20210715

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20210906

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20211203

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20220421

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20220719

A02 Decision of refusal

Free format text: JAPANESE INTERMEDIATE CODE: A02

Effective date: 20221027

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20230216

C60 Trial request (containing other claim documents, opposition documents)

Free format text: JAPANESE INTERMEDIATE CODE: C60

Effective date: 20230216

A911 Transfer to examiner for re-examination before appeal (zenchi)

Free format text: JAPANESE INTERMEDIATE CODE: A911

Effective date: 20230227

C21 Notice of transfer of a case for reconsideration by examiners before appeal proceedings

Free format text: JAPANESE INTERMEDIATE CODE: C21

Effective date: 20230228

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20230317

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20230406

R150 Certificate of patent or registration of utility model

Ref document number: 7260243

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R150