CN102016915B - 用于图像的超分辨率的方法与设备 - Google Patents

用于图像的超分辨率的方法与设备 Download PDF

Info

Publication number
CN102016915B
CN102016915B CN200980114216.8A CN200980114216A CN102016915B CN 102016915 B CN102016915 B CN 102016915B CN 200980114216 A CN200980114216 A CN 200980114216A CN 102016915 B CN102016915 B CN 102016915B
Authority
CN
China
Prior art keywords
resolution image
resolution
motion
low
images
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN200980114216.8A
Other languages
English (en)
Chinese (zh)
Other versions
CN102016915A (zh
Inventor
Y·贾
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
ATI Technologies ULC
Original Assignee
ATI Technologies ULC
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by ATI Technologies ULC filed Critical ATI Technologies ULC
Publication of CN102016915A publication Critical patent/CN102016915A/zh
Application granted granted Critical
Publication of CN102016915B publication Critical patent/CN102016915B/zh
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00—Geometric image transformations in the plane of the image
    • G06T3/40—Scaling of whole images or parts thereof, e.g. expanding or contracting
    • G06T3/4053—Scaling of whole images or parts thereof, e.g. expanding or contracting based on super-resolution, i.e. the output image resolution being higher than the sensor resolution

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Image Analysis (AREA)
  • Television Systems (AREA)
  • Image Processing (AREA)
CN200980114216.8A 2008-03-17 2009-03-12 用于图像的超分辨率的方法与设备 Active CN102016915B (zh)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US12/076,347 2008-03-17
US12/076,347 US8306121B2 (en) 2008-03-17 2008-03-17 Method and apparatus for super-resolution of images
PCT/IB2009/000508 WO2009115885A2 (en) 2008-03-17 2009-03-12 Method and apparatus for super-resolution of images

Publications (2)

Publication Number Publication Date
CN102016915A CN102016915A (zh) 2011-04-13
CN102016915B true CN102016915B (zh) 2014-02-26

Family

ID=41063000

Family Applications (1)

Application Number Title Priority Date Filing Date
CN200980114216.8A Active CN102016915B (zh) 2008-03-17 2009-03-12 用于图像的超分辨率的方法与设备

Country Status (6)

Country Link
US (1) US8306121B2 (https=)
EP (1) EP2266095B1 (https=)
JP (1) JP5385969B2 (https=)
KR (1) KR101393048B1 (https=)
CN (1) CN102016915B (https=)
WO (1) WO2009115885A2 (https=)

Families Citing this family (51)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8233541B2 (en) * 2008-03-26 2012-07-31 Sony Corporation Recursive image quality enhancement on super resolution video
JP4504443B2 (ja) * 2008-08-12 2010-07-14 株式会社東芝 再生装置および再生装置の制御方法
JP2012044233A (ja) * 2008-12-12 2012-03-01 Panasonic Corp 再生装置
JP4564565B2 (ja) * 2009-01-27 2010-10-20 株式会社東芝 再生装置および再生装置の制御方法
US8989519B2 (en) * 2009-04-20 2015-03-24 Yeda Research & Development Co. Ltd. Super resolution from a single signal
US8724928B2 (en) 2009-08-31 2014-05-13 Intellectual Ventures Fund 83 Llc Using captured high and low resolution images
US8750645B2 (en) * 2009-12-10 2014-06-10 Microsoft Corporation Generating a composite image from video frames
US8558948B2 (en) * 2009-12-17 2013-10-15 Broadcom Corporation System, method, and apparatus for providing improved high definition video from upsampled standard definition video
JP2011180798A (ja) * 2010-03-01 2011-09-15 Sony Corp 画像処理装置、および画像処理方法、並びにプログラム
US8179445B2 (en) * 2010-03-03 2012-05-15 Eastman Kodak Company Providing improved high resolution image
JP2011237998A (ja) * 2010-05-10 2011-11-24 Sony Corp 画像処理装置、および画像処理方法、並びにプログラム
JP5654867B2 (ja) 2010-12-27 2015-01-14 パナソニックＩｐマネジメント株式会社 映像信号処理装置及び映像信号処理方法
CN102063730B (zh) * 2011-01-14 2012-09-12 华中科技大学 基于单分子定位的快速超分辨成像方法及系统
US9089274B2 (en) * 2011-01-31 2015-07-28 Seiko Epson Corporation Denoise MCG measurements
US8818124B1 (en) 2011-03-04 2014-08-26 Exelis, Inc. Methods, apparatus, and systems for super resolution of LIDAR data sets
US8594464B2 (en) 2011-05-26 2013-11-26 Microsoft Corporation Adaptive super resolution for video enhancement
CN102880878B (zh) * 2011-07-15 2015-05-06 富士通株式会社 一种基于单幅图像进行超分辨率分析的方法及系统
US20130169834A1 (en) * 2011-12-30 2013-07-04 Advanced Micro Devices, Inc. Photo extraction from video
KR101341617B1 (ko) * 2012-03-14 2013-12-13 중앙대학교 산학협력단 단일 영상의 오차모델을 기반으로 한 고해상도 영상 복원장치 및 방법
CN103458154B (zh) * 2012-05-31 2016-03-30 北京大学 一种视频的超分辨率方法及装置
EP2677733A3 (en) * 2012-06-18 2015-12-09 Sony Mobile Communications AB Array camera imaging system and method
CN104619237B (zh) 2012-07-26 2018-03-30 德普伊辛迪斯制品公司 光不足环境中的ycbcr脉冲调制的照明方案
EP2992810B1 (en) 2012-07-26 2021-11-10 DePuy Synthes Products, Inc. Continuous video in a light deficient environment
KR101538313B1 (ko) * 2012-12-21 2015-07-22 서울시립대학교 산학협력단 블록단위 영상 정합을 이용한 초해상도 영상 복원 방법 및 장치
CA2906821A1 (en) 2013-03-15 2014-09-18 Olive Medical Corporation Scope sensing in a light controlled environment
EP3459431A1 (en) 2013-03-15 2019-03-27 DePuy Synthes Products, Inc. Controlling the integral light energy of a laser pulse
CA2906798A1 (en) * 2013-03-15 2014-09-18 Olive Medical Corporation Super resolution and color motion artifact correction in a pulsed color imaging system
CN105580053B (zh) 2013-09-27 2019-03-01 皇家飞利浦有限公司 运动补偿的迭代重建
WO2015143453A1 (en) 2014-03-21 2015-09-24 Olive Medical Corporation Card edge connector for an imaging sensor
KR102374022B1 (ko) * 2014-09-26 2022-03-14 삼성전자주식회사 영상 처리 장치 및 방법
WO2016048108A1 (en) * 2014-09-26 2016-03-31 Samsung Electronics Co., Ltd. Image processing apparatus and image processing method
CN105590304B (zh) * 2014-10-24 2019-01-08 北京大学 超分辨率图像重建方法和装置
GB2539846B (en) 2015-02-19 2017-11-01 Magic Pony Tech Ltd Online training of hierarchical algorithms
EP3278559B1 (en) 2015-03-31 2021-05-05 Magic Pony Technology Limited Training end-to-end video processes
GB201604672D0 (en) 2016-03-18 2016-05-04 Magic Pony Technology Ltd Generative methods of super resolution
GB201603144D0 (en) 2016-02-23 2016-04-06 Magic Pony Technology Ltd Training end-to-end video processes
KR102584187B1 (ko) 2016-03-30 2023-10-05 삼성전자주식회사 이미지를 처리하기 위한 전자 장치 및 방법
WO2017178808A1 (en) 2016-04-12 2017-10-19 Magic Pony Technology Limited Visual data processing using energy networks
GB201607994D0 (en) 2016-05-06 2016-06-22 Magic Pony Technology Ltd Encoder pre-analyser
RU2635883C1 (ru) * 2016-06-02 2017-11-16 Самсунг Электроникс Ко., Лтд. Способ и система обработки изображений для формирования изображений сверхвысокого разрешения
US10366480B2 (en) * 2016-07-01 2019-07-30 Analytical Mechanics Associates, Inc. Super-resolution systems and methods
US10504206B2 (en) * 2016-07-06 2019-12-10 Micro Biz Ventures LLC Method and system for processing images from a remote image detector
WO2019102476A2 (en) * 2017-11-26 2019-05-31 Yeda Research And Development Co. Ltd. Signal enhancement and manipulation using a signal-specific deep network
CN112369009B (zh) 2018-08-08 2022-06-07 谷歌有限责任公司 用于创建场景的超分辨率图像的光学图像稳定移动
KR102555317B1 (ko) 2018-08-09 2023-07-14 구글 엘엘씨 사용자 디바이스에 적용된 내추럴 핸드헬드 모션을 이용한 초해상도
US10990826B1 (en) * 2019-03-20 2021-04-27 Xilinx, Inc. Object detection in video
CN114339260B (zh) * 2020-09-30 2025-09-05 华为技术有限公司 图像处理方法及装置
JP7763113B2 (ja) * 2022-02-01 2025-10-31 キヤノン株式会社 画像処理装置および方法、プログラム
JP7765298B2 (ja) * 2022-02-01 2025-11-06 キヤノン株式会社 画像処理装置および方法、プログラム
US20240265494A1 (en) * 2023-02-07 2024-08-08 Microsoft Technology Licensing, Llc Realtime video super resolution using motion vectors
CN116523758B (zh) * 2023-07-03 2023-09-19 清华大学 基于关键帧的端云联合超分辨率视频重建方法及系统

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1578449A (zh) * 2003-06-27 2005-02-09 成津C&C株式会社 从低分辨率压缩图像恢复并重构超分辨率图像的方法
TW200631401A (en) * 2005-02-22 2006-09-01 Sunplus Technology Co Ltd Method and system for dynamically adjusting motion estimation
US20080002239A1 (en) * 2006-06-28 2008-01-03 Tadamasa Toma Image reading method and image expansion method

Family Cites Families (30)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2596352B2 (ja) 1993-12-10 1997-04-02 日本電気株式会社 小数精度動きベクトル探索装置
JPH07288817A (ja) 1994-04-19 1995-10-31 Sony Corp 動きベクトル検出装置
US5696848A (en) * 1995-03-09 1997-12-09 Eastman Kodak Company System for creating a high resolution image from a sequence of lower resolution motion images
US6487249B2 (en) * 1998-10-09 2002-11-26 Matsushita Electric Industrial Co., Ltd. Efficient down conversion system for 2:1 decimation
ATE552572T1 (de) * 2000-12-01 2012-04-15 Imax Corp Verfahren und vorrichtung zum erzeugen hochauflösender bilder
US7215831B2 (en) * 2001-04-26 2007-05-08 Georgia Tech Research Corp. Video enhancement using multiple frame techniques
AU2003272936A1 (en) * 2003-01-31 2004-08-23 The Circle For The Promotion Of Science And Engineering Method for creating high resolution color image, system for creating high resolution color image and program for creating high resolution color image
IL160152A (en) * 2004-02-01 2011-06-30 Rafael Advanced Defense Sys Super-resolution image processing
US20050219642A1 (en) * 2004-03-30 2005-10-06 Masahiko Yachida Imaging system, image data stream creation apparatus, image generation apparatus, image data stream generation apparatus, and image data stream generation system
US8036494B2 (en) * 2004-04-15 2011-10-11 Hewlett-Packard Development Company, L.P. Enhancing image resolution
US7420592B2 (en) * 2004-06-17 2008-09-02 The Boeing Company Image shifting apparatus for enhanced image resolution
JP2006033141A (ja) 2004-07-13 2006-02-02 Seiko Epson Corp 画像処理装置、画像処理方法、プログラムおよび記録媒体
JP2006174415A (ja) * 2004-11-19 2006-06-29 Ntt Docomo Inc 画像復号装置、画像復号プログラム、画像復号方法、画像符号化装置、画像符号化プログラム及び画像符号化方法
US20060291751A1 (en) * 2004-12-16 2006-12-28 Peyman Milanfar Robust reconstruction of high resolution grayscale images from a sequence of low-resolution frames (robust gray super-resolution)
US20060291750A1 (en) * 2004-12-16 2006-12-28 Peyman Milanfar Dynamic reconstruction of high resolution video from low-resolution color-filtered video (video-to-video super-resolution)
US7412107B2 (en) * 2004-12-17 2008-08-12 The Regents Of The University Of California, Santa Cruz System and method for robust multi-frame demosaicing and color super-resolution
JP4126378B2 (ja) * 2005-05-02 2008-07-30 国立大学法人東京工業大学 超解像処理の高速化方法
FR2886787A1 (fr) * 2005-06-06 2006-12-08 Thomson Licensing Sa Procede et dispositif de codage et de decodage d'une sequence d'images
JP4600209B2 (ja) * 2005-08-18 2010-12-15 ソニー株式会社 画像処理方法、画像処理装置、プログラムおよび記録媒体
JP4594201B2 (ja) * 2005-09-28 2010-12-08 パナソニック株式会社 画像符号化方法、画像符号化装置、プログラムおよび集積回路
KR100786426B1 (ko) * 2006-03-17 2007-12-17 주식회사 팬택앤큐리텔 다 해상도 탐색 방법을 이용한 움직임 벡터 추출 방법 및장치
US20070285500A1 (en) * 2006-04-21 2007-12-13 Dilithium Holdings, Inc. Method and Apparatus for Video Mixing
JP4116649B2 (ja) * 2006-05-22 2008-07-09 株式会社東芝 高解像度化装置および方法
JP2007329678A (ja) * 2006-06-07 2007-12-20 Matsushita Electric Ind Co Ltd 輝度マスキング及び輝度補償を用いた超解像処理方法及び装置
US20080018788A1 (en) * 2006-07-20 2008-01-24 Samsung Electronics Co., Ltd. Methods and systems of deinterlacing using super resolution technology
JP4646146B2 (ja) * 2006-11-30 2011-03-09 ソニー株式会社 画像処理装置、画像処理方法、およびプログラム
US8737485B2 (en) * 2007-01-31 2014-05-27 Sony Corporation Video coding mode selection system
JP4356777B2 (ja) * 2007-06-18 2009-11-04 ソニー株式会社 画像処理装置、画像処理方法、プログラム、及び記録媒体
US7974498B2 (en) * 2007-08-08 2011-07-05 Microsoft Corporation Super-resolution in periodic and aperiodic pixel imaging
JP5076755B2 (ja) * 2007-09-07 2012-11-21 ソニー株式会社 画像処理装置、および画像処理方法、並びにコンピュータ・プログラム

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1578449A (zh) * 2003-06-27 2005-02-09 成津C&C株式会社 从低分辨率压缩图像恢复并重构超分辨率图像的方法
TW200631401A (en) * 2005-02-22 2006-09-01 Sunplus Technology Co Ltd Method and system for dynamically adjusting motion estimation
US20080002239A1 (en) * 2006-06-28 2008-01-03 Tadamasa Toma Image reading method and image expansion method

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
《联合运动估计与基于模式的超分辨率图像重构》;张地，彭宏;《电子学报》;20080131;第36卷(第1期);第180-183页 *
刘潇,陈燕.《从低分辨率压缩视频流恢复高分辨率图像》.《中国石油大学学报(自然科学版)》.2006,第30卷(第6期),第160-163页. *

Also Published As

Publication number Publication date
US8306121B2 (en) 2012-11-06
JP2011514605A (ja) 2011-05-06
KR20100139030A (ko) 2010-12-31
EP2266095B1 (en) 2019-04-24
WO2009115885A2 (en) 2009-09-24
CN102016915A (zh) 2011-04-13
KR101393048B1 (ko) 2014-05-27
WO2009115885A3 (en) 2009-11-12
JP5385969B2 (ja) 2014-01-08
EP2266095A2 (en) 2010-12-29
EP2266095A4 (en) 2015-01-28
US20090232213A1 (en) 2009-09-17

Similar Documents

Publication Publication Date Title
CN102016915B (zh) 用于图像的超分辨率的方法与设备
Lertrattanapanich et al. High resolution image formation from low resolution frames using Delaunay triangulation
Lee et al. Regularized adaptive high-resolution image reconstruction considering inaccurate subpixel registration
Jiji et al. Single‐frame image super‐resolution using learned wavelet coefficients
US9652830B2 (en) Method and apparatus for performing hierarchical super-resolution of an input image
KR20140135968A (ko) 초해상도화를 수행하는 방법 및 장치
Cha et al. Edge-forming methods for color image zooming
Adam et al. Denoising by inpainting
CN111767679B (zh) 时变矢量场数据的处理方法及装置
Khosravi et al. Data compression in ViSAR sensor networks using non-linear adaptive weighting
JP2000152250A (ja) 画像処理装置、方法及びコンピュータ読み取り可能な記憶媒体
EP1906357A1 (en) Combined optimization of motion estimator and super-resolution
Aydin et al. A linear well-posed solution to recover high-frequency information for super resolution image reconstruction
Shao et al. Partition-based interpolation for color filter array demosaicking and super-resolution reconstruction
Chen et al. Single satellite imagery superresolution based on hybrid nonlocal similarity constrained convolution sparse coding
Liu et al. Hyperspectral image super-resolution employing nonlocal block and hybrid multiscale three-dimensional convolution
Giovanneschi et al. Convolutional Sparse Coding and Dictionary Learning for Lidar Depth Completion in Automotive Scenarios
Kim et al. Variational approaches to super-resolution with contrast enhancement and anisotropic diffusion
Meng et al. The lower bound of nonlocal gradient for non-convex and non-smooth image patches based regularization
Kamgang et al. Adaptive frequency time-distribution network—a multiscale deblurring technique: VB Kamgang et al.
Pestak Development of an efficient super-resolution image reconstruction algorithm for implementation on a hardware platform
Mareboyana et al. High resolution image reconstruction from projection of low resolution images differing in subpixel shifts
Mulcahy-Stanislawczyk et al. Super Resolving Unrolled Neural Networks for Remote Sensing
Zerva et al. An improved regularization method for video super-resolution using an effective prior
Ponomaryov et al. Image resolution enhancement using edge extraction and sparse representation in wavelet domain for real-time application

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant