WO2002005208A3 - Method and apparatus for enhancing data resolution - Google Patents

Method and apparatus for enhancing data resolution Download PDF

Info

Publication number
WO2002005208A3
WO2002005208A3 PCT/US2001/021311 US0121311W WO0205208A3 WO 2002005208 A3 WO2002005208 A3 WO 2002005208A3 US 0121311 W US0121311 W US 0121311W WO 0205208 A3 WO0205208 A3 WO 0205208A3
Authority
WO
WIPO (PCT)
Prior art keywords
resolution
data
mapping
images
mosaic
Prior art date
Application number
PCT/US2001/021311
Other languages
French (fr)
Other versions
WO2002005208A2 (en
Inventor
Shree K Nayar
Srinivasa G Narasimhan
Original Assignee
Univ Columbia
Shree K Nayar
Srinivasa G Narasimhan
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Univ Columbia, Shree K Nayar, Srinivasa G Narasimhan filed Critical Univ Columbia
Priority to JP2002508740A priority Critical patent/JP4234420B2/en
Priority to US10/312,529 priority patent/US7149262B1/en
Priority to AU2001271847A priority patent/AU2001271847A1/en
Priority to KR1020037000187A priority patent/KR100850729B1/en
Publication of WO2002005208A2 publication Critical patent/WO2002005208A2/en
Publication of WO2002005208A3 publication Critical patent/WO2002005208A3/en

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T1/00—General purpose image data processing
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00—Geometric image transformation in the plane of the image
    • G06T3/40—Scaling the whole image or part thereof
    • G06T3/4015—Demosaicing, e.g. colour filter array [CFA], Bayer pattern
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/08—Learning methods
    • G06N3/084—Backpropagation, e.g. using gradient descent
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N7/00—Computing arrangements based on specific mathematical models
    • G06N7/01—Probabilistic graphical models, e.g. probabilistic networks
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00—Geometric image transformation in the plane of the image
    • G06T3/40—Scaling the whole image or part thereof
    • G06T3/4007—Interpolation-based scaling, e.g. bilinear interpolation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/117—Filters, e.g. for pre-processing or post-processing
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/154—Measured or subjectively estimated visual quality after decoding, e.g. measurement of distortion
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/80—Details of filtering operations specially adapted for video compression, e.g. for pixel interpolation

Abstract

An algorithm is provided for enhancing the resolution of various types of data such as image data. The data being enhanced can be data which has been sampled using a locally inhomogeneous sensitivity pattern such as a Bayer-type color mosaic, an exposure-level mosaic, or a combined color and exposure-level mosaic. The resolution enhancement algorithm uses high resolution and low resolution versions of a sample image to 'learn' (i.e., optimize) a set of parameters of a mapping from the low resolution data to the high resolution data. The mapping can comprise a polynomial model. The learning procedure is repeated for a variety of sample images. The learned mapping can then be used to process other low resolution images to obtain corresponding, higher resolution images. The learned mapping provides resolution enhancement which is superior to that of conventional interpolation techniques.
PCT/US2001/021311 2000-07-06 2001-07-06 Method and apparatus for enhancing data resolution WO2002005208A2 (en)

Priority Applications (4)

Application Number Priority Date Filing Date Title
JP2002508740A JP4234420B2 (en) 2000-07-06 2001-07-06 Method and apparatus for increasing data resolution
US10/312,529 US7149262B1 (en) 2000-07-06 2001-07-06 Method and apparatus for enhancing data resolution
AU2001271847A AU2001271847A1 (en) 2000-07-06 2001-07-06 Method and apparatus for enhancing data resolution
KR1020037000187A KR100850729B1 (en) 2000-07-06 2001-07-06 Method and apparatus for enhancing data resolution

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US21639500P 2000-07-06 2000-07-06
US60/216,395 2000-07-06

Publications (2)

Publication Number Publication Date
WO2002005208A2 WO2002005208A2 (en) 2002-01-17
WO2002005208A3 true WO2002005208A3 (en) 2003-06-26

Family

ID=22806896

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2001/021311 WO2002005208A2 (en) 2000-07-06 2001-07-06 Method and apparatus for enhancing data resolution

Country Status (5)

Country Link
JP (1) JP4234420B2 (en)
KR (1) KR100850729B1 (en)
CN (1) CN1520580A (en)
AU (1) AU2001271847A1 (en)
WO (1) WO2002005208A2 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10623756B2 (en) 2015-02-19 2020-04-14 Magic Pony Technology Limited Interpolating visual data

Families Citing this family (31)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2006506875A (en) * 2002-11-19 2006-02-23 コーニンクレッカ　フィリップス　エレクトロニクス　エヌ　ヴィ Image conversion apparatus and method
US20050226525A1 (en) * 2004-03-31 2005-10-13 Fujitsu Limited Image magnification device and image magnification method
WO2006059504A1 (en) 2004-11-30 2006-06-08 Matsushita Electric Industrial Co., Ltd. Image processing method, image processing device, image processing program, and image file format
CN100425080C (en) * 2005-05-25 2008-10-08 凌阳科技股份有限公司 Edge strengthening method and device of Bel image and color image pick-up system
JP3996631B2 (en) 2005-09-09 2007-10-24 松下電器産業株式会社 Image processing method, image recording method, image processing apparatus, and image file format
US8115840B2 (en) * 2005-11-10 2012-02-14 DigitalOptics Corporation International Image enhancement in the mosaic domain
US7742636B2 (en) * 2006-01-26 2010-06-22 Nethra Imaging Inc. Method and apparatus for scaling down a bayer domain image
MX2010000931A (en) * 2007-07-25 2010-04-21 Candela Microsystems S Pte Ltd Exposure control for an imagning system.
US8564700B2 (en) * 2007-12-07 2013-10-22 Panasonic Corporation Image processing device, image processing method, and imaging device using a patterned polarizer
JP5057389B2 (en) * 2008-03-31 2012-10-24 富士フイルム株式会社 Imaging device
US7964840B2 (en) * 2008-06-19 2011-06-21 Omnivision Technologies, Inc. High dynamic range image sensor including polarizer and microlens
EP2175632A1 (en) 2008-10-10 2010-04-14 Samsung Electronics Co., Ltd. Image processing apparatus and method
JP2010109798A (en) * 2008-10-31 2010-05-13 Fujifilm Corp Imaging apparatus
CN101976435B (en) * 2010-10-07 2012-10-24 西安电子科技大学 Combination learning super-resolution method based on dual constraint
GB201604672D0 (en) 2016-03-18 2016-05-04 Magic Pony Technology Ltd Generative methods of super resolution
GB201603144D0 (en) 2016-02-23 2016-04-06 Magic Pony Technology Ltd Training end-to-end video processes
WO2016156864A1 (en) 2015-03-31 2016-10-06 Magic Pony Technology Limited Training end-to-end video processes
EP3298579B1 (en) 2016-04-12 2021-07-21 Magic Pony Technology Limited Visual data processing using energy networks
GB201607994D0 (en) 2016-05-06 2016-06-22 Magic Pony Technology Ltd Encoder pre-analyser
US10701394B1 (en) 2016-11-10 2020-06-30 Twitter, Inc. Real-time video super-resolution with spatio-temporal networks and motion compensation
JP7037584B2 (en) * 2017-06-16 2022-03-16 ドルビー ラボラトリーズ ライセンシング コーポレイション Efficient end-to-end single layer reverse display management coding
CN109284719A (en) * 2018-09-28 2019-01-29 成都臻识科技发展有限公司 A kind of primary data processing method and system based on machine learning
CN109451249A (en) * 2018-11-23 2019-03-08 中国科学院长春光学精密机械与物理研究所 A kind of method, device and equipment improving numeric field TDI imaging dynamic range
CN110189419B (en) * 2019-05-27 2022-09-16 西南交通大学 Vehicle-mounted Lidar steel rail point cloud extraction method based on generalized neighborhood height difference
KR102242939B1 (en) * 2019-06-13 2021-04-21 엘지이노텍 주식회사 Camera Device and Image Generation Method Of Camera Device
KR20200142883A (en) 2019-06-13 2020-12-23 엘지이노텍 주식회사 Camera Device and Image Generation Method Of Camera Device
TW202105028A (en) * 2019-06-13 2021-02-01 韓商Ｌｇ伊諾特股份有限公司 Camera device and image generation method of camera device
KR102213765B1 (en) * 2019-08-09 2021-02-08 엘지이노텍 주식회사 An Image Sensor, A Camera Module And Optical Device Comprising A Camera Module
KR102428840B1 (en) * 2019-10-16 2022-08-04 (주)아인스에스엔씨 Computing system implementing and operating models describing transition between multiple resolution-based models
KR20210018381A (en) * 2021-02-02 2021-02-17 엘지이노텍 주식회사 An Image Sensor, A Camera Module And Optical Device Comprising A Camera Module
CN117314795B (en) * 2023-11-30 2024-02-27 成都玖锦科技有限公司 SAR image enhancement method by using background data

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO1994018801A1 (en) * 1993-02-08 1994-08-18 I Sight, Inc. Color wide dynamic range camera using a charge coupled device with mosaic filter
US5475769A (en) * 1992-07-13 1995-12-12 Polaroid Corporation Method and apparatus for recovering image data through the use of a color test pattern
EP0930789A2 (en) * 1998-01-20 1999-07-21 Hewlett-Packard Company Colour image pickup device

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CH657876A5 (en) * 1982-04-28 1986-09-30 Rueti Ag Maschf ROW SPECIAL WAVING MACHINE WITH A WEB ROTOR.

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5475769A (en) * 1992-07-13 1995-12-12 Polaroid Corporation Method and apparatus for recovering image data through the use of a color test pattern
WO1994018801A1 (en) * 1993-02-08 1994-08-18 I Sight, Inc. Color wide dynamic range camera using a charge coupled device with mosaic filter
EP0930789A2 (en) * 1998-01-20 1999-07-21 Hewlett-Packard Company Colour image pickup device

Non-Patent Citations (4)

* Cited by examiner, † Cited by third party
Title
BEN-EZRA M: "SEGMENTATION WITH INVISIBLE KEYING SIGNAL", PROCEEDINGS 2000 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION. CVPR 2000. HILTON HEAD ISLAND, SC, JUNE 13-15, 2000, PROCEEDINGS OF THE IEEE COMPUTER CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, LOS ALAMITOS, CA: IEEE COMP. SOC, vol. 1 OF 2, 13 June 2000 (2000-06-13), pages 32 - 37, XP001035586, ISBN: 0-7803-6527-5 *
FREEMAN W T ET AL: "Learning low-level vision", COMPUTER VISION, 1999. THE PROCEEDINGS OF THE SEVENTH IEEE INTERNATIONAL CONFERENCE ON KERKYRA, GREECE 20-27 SEPT. 1999, LOS ALAMITOS, CA, USA,IEEE COMPUT. SOC, US, 20 September 1999 (1999-09-20), pages 1182 - 1189, XP010350543, ISBN: 0-7695-0164-8 *
PRESS W.H., ET AL.: "Numerical Recipes in C: the art of scientific computing - 2nd edition", 1992, CAMBRIDGE UNIVERSITY PRESS, XP002220468 *
S.K. NAYAR, T. MITSUNAGA: "High Dynamic Range Imaging: Spatially Varying Pixel Exposures", PROCEEDINGS OF THE IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION. CVPR 2000, 13 June 2000 (2000-06-13) - 15 June 2000 (2000-06-15), Hilton Head Island, SC, USA, pages 472 - 479, XP002236923 *

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10623756B2 (en) 2015-02-19 2020-04-14 Magic Pony Technology Limited Interpolating visual data

Also Published As

Publication number Publication date
JP4234420B2 (en) 2009-03-04
JP2004518312A (en) 2004-06-17
CN1520580A (en) 2004-08-11
WO2002005208A2 (en) 2002-01-17
AU2001271847A1 (en) 2002-01-21
KR100850729B1 (en) 2008-08-06
KR20030020357A (en) 2003-03-08

Similar Documents

Publication Publication Date Title
WO2002005208A3 (en) Method and apparatus for enhancing data resolution
CN111062880B (en) Underwater image real-time enhancement method based on condition generation countermeasure network
AU9088491A (en) Method and apparatus for halftone rendering of a gray scale image using a blue noise mask
IL120633A0 (en) Method and apparatus of inputting and outputting color pictures and continually-changing tone pictures
WO1999034321A3 (en) Producing an enhanced raster image
EP1403813A3 (en) Image processing method, apparatus and program for dealing with inverted characters
EP1223550A3 (en) Method for detecting skin color in a digital image
EP1014688B8 (en) Image processing method and apparatus, image processing system, and storage medium
WO2004102474A3 (en) A method and device for sensor level image distortion abatement
EP1185082A3 (en) Method and apparatus for correcting white balance
EP0929191A3 (en) Image correction method
EP1331806A4 (en) Image processing device, image processing method, recorded medium, and program
WO2003010525A1 (en) Method for evaluating contamination of object surface and imaging box used for this method
EP0982932A3 (en) Apparatus and method of performing dithering in a simplex in color space
Yang et al. Low‐light image enhancement based on Retinex decomposition and adaptive gamma correction
WO1992010057A3 (en) Printing apparatus and method
EP1223745A3 (en) System and method for processing image data, computer program for performing the method and data storage medium carrying the program
CN113034388B (en) Ancient painting virtual repair method and construction method of repair model
CA2397872A1 (en) Correction of distortions in form processing
NO965120D0 (en) Procedure for Modifying the Resolution of a Digitized Image
EP1339023A3 (en) Method for producing shading effects
EP1067477A3 (en) Pixel resolution converting circuit and image display using the same
CN102685370B (en) De-noising method and device of video sequence
EP1122690A3 (en) Pattern matching method and apparatus
JPH06208620A (en) Description patern generation method and device thereof

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A2

Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BY BZ CA CH CN CO CR CU CZ DE DK DM DZ EC EE ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NO NZ PL PT RO RU SD SE SG SI SK SL TJ TM TR TT TZ UA UG US UZ VN YU ZA ZW

AL Designated countries for regional patents

Kind code of ref document: A2

Designated state(s): GH GM KE LS MW MZ SD SL SZ TZ UG ZW AM AZ BY KG KZ MD RU TJ TM AT BE CH CY DE DK ES FI FR GB GR IE IT LU MC NL PT SE TR BF BJ CF CG CI CM GA GN GW ML MR NE SN TD TG

121 Ep: the epo has been informed by wipo that ep was designated in this application
DFPE Request for preliminary examination filed prior to expiration of 19th month from priority date (pct application filed before 20040101)
REG Reference to national code

Ref country code: DE

Ref legal event code: 8642

WWE Wipo information: entry into national phase

Ref document number: 1020037000187

Country of ref document: KR

WWE Wipo information: entry into national phase

Ref document number: 018151043

Country of ref document: CN

WWP Wipo information: published in national office

Ref document number: 1020037000187

Country of ref document: KR

ENP Entry into the national phase

Country of ref document: RU

Kind code of ref document: A

Format of ref document f/p: F

ENP Entry into the national phase

Country of ref document: RU

Kind code of ref document: A

Format of ref document f/p: F

122 Ep: pct application non-entry in european phase