CA2797054A1 - Infrared resolution and contrast enhancement with fusion - Google Patents
Infrared resolution and contrast enhancement with fusion Download PDFInfo
- Publication number
- CA2797054A1 CA2797054A1 CA2797054A CA2797054A CA2797054A1 CA 2797054 A1 CA2797054 A1 CA 2797054A1 CA 2797054 A CA2797054 A CA 2797054A CA 2797054 A CA2797054 A CA 2797054A CA 2797054 A1 CA2797054 A1 CA 2797054A1
- Authority
- CA
- Canada
- Prior art keywords
- image
- resolution
- visual image
- visual
- combining
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 230000004927 fusion Effects 0.000 title 1
- 230000000007 visual effect Effects 0.000 claims abstract 36
- 238000000034 method Methods 0.000 claims abstract 23
- 238000004590 computer program Methods 0.000 claims 5
- 238000001914 filtration Methods 0.000 claims 3
- 238000003384 imaging method Methods 0.000 claims 3
- 238000005070 sampling Methods 0.000 claims 2
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/50—Image enhancement or restoration by the use of more than one image, e.g. averaging, subtraction
-
- G06T5/70—
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10048—Infrared image
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20212—Image combination
- G06T2207/20221—Image fusion; Image merging
Abstract
The present disclosure relates to combination of images. A method according to an embodiment comprises: receiving a visual image and an infrared (IR) image of a scene; extracting high spatial frequency content from said visual image; and combining said extracted high spatial frequency content from said visual image with said IR image, wherein a resolution for the visual image and the IR image are substantially the same, to generate a combined image.
Claims (25)
1. A method, comprising:
receiving a visual image and an infrared (IR) image of a scene;
extracting high spatial frequency content from said visual image; and combining said extracted high spatial frequency content from said visual image with said IR image, wherein a resolution for the visual image and the IR image are substantially the same, to generate a combined image.
receiving a visual image and an infrared (IR) image of a scene;
extracting high spatial frequency content from said visual image; and combining said extracted high spatial frequency content from said visual image with said IR image, wherein a resolution for the visual image and the IR image are substantially the same, to generate a combined image.
2. The method of the preceding claim, further comprising ensuring that a resolution for the visual image and the IR image are substantially the same.
3. The method of any of the preceding claims, further comprising checking whether a resolution for the visual image and the IR image are substantially the same;
and wherein, if the resolution for the visual image and the IR image are not substantially the same, altering a resolution of the visual image and/or a resolution of the IR image such that the resolution for the visual image and the IR image are substantially the same.
and wherein, if the resolution for the visual image and the IR image are not substantially the same, altering a resolution of the visual image and/or a resolution of the IR image such that the resolution for the visual image and the IR image are substantially the same.
4. The method of any of the preceding claims, further comprising altering at least one of a resolution of said visual image and a resolution of said IR image such that the visual image and the IR image have substantially the same resolution.
5. The method of any of the preceding claims, further comprising up-sampling a resolution of said IR image to substantially a resolution of said visual image and/or down-sampling the resolution of said visual image to substantially the resolution of said IR image.
6. The method of any of the preceding claims, further comprising altering a resolution of said visual image and a resolution of said IR image to be substantially the same as a third resolution.
7. The method of any of the preceding claims, wherein a resolution of the received IR
image is 64×64 pixels or less.
image is 64×64 pixels or less.
8. The method of any of the preceding claims, wherein a resolution of the received IR
image is 32×32 pixels or less.
image is 32×32 pixels or less.
9. The method of any of the preceding claims, wherein the extracting high spatial frequency content from said visual image is performed by high pass filtering using at least one spatial filter.
10. The method of any of the preceding claims, further comprising processing said IR
image to reduce noise in the IR image and/or smooth the IR image.
image to reduce noise in the IR image and/or smooth the IR image.
11. The method of any of the preceding claims, further comprising low pass filtering said IR image prior to the combining.
12. The method of any of the preceding claims, further comprising low pass filtering said IR image by use of a spatial filter prior to the combining.
13. The method of any of the preceding claims, wherein the combining comprises superimposing said extracted high spatial frequency content from said visual image on said IR image.
14. The method of any of the preceding claims, wherein the combining comprises superimposing said IR image on said extracted high spatial frequency content from said visual image.
15. The method of any of the preceding claims, wherein the combining further comprises adding a luminance component of said visual image to said IR image.
16. The method of any of the preceding claims, wherein the combining further comprises adding a luminance component of said visual image multiplied by a factor to said IR
image.
image.
17. The method of the preceding claim, wherein said factor is variable based on a control parameter received from an input from a user.
18. The method any of the preceding claims, further comprising adding high resolution noise to said combined image.
19. The method of any of the preceding claims, further comprising maintaining an IR
palette for said IR image and/or for said combined image.
palette for said IR image and/or for said combined image.
20. The method of any of the preceding claims, further comprising capturing a visual image and an IR image of a scene, and wherein the method of claim 1 is performed by an imaging device comprising an IR image capturing device and a visual image capturing device.
21. The method of any of the preceding claims being performed in a computer being adapted to receive a visual image and an IR image of a scene.
22. A non-transitory computer program product for combining an IR image with a visual image, the computer program product comprising computer program code portions devised to control a data processing system to perform operations comprising:
receiving a visual image and an IR image of a scene;
extracting high spatial frequency content from said visual image; and combining said extracted high spatial frequency content from said visual image with said IR image, wherein a resolution for the visual image and the IR image are substantially the same, to generate a combined image.
receiving a visual image and an IR image of a scene;
extracting high spatial frequency content from said visual image; and combining said extracted high spatial frequency content from said visual image with said IR image, wherein a resolution for the visual image and the IR image are substantially the same, to generate a combined image.
23. The computer program product of the preceding claim, further comprising computer program code portions devised to control a data processing system to perform the steps or functions of any of claims 2-21.
24. An imaging device, comprising:
a visual image sensor for capturing a visual image;
an IR image sensor for capturing an IR image; and a processing unit adapted to extract high spatial frequency content from said visual image and to combine said extracted high spatial frequency content from said visual image with said IR image, wherein a resolution for the visual image and the IR
image are substantially the same, to generate a combined image.
a visual image sensor for capturing a visual image;
an IR image sensor for capturing an IR image; and a processing unit adapted to extract high spatial frequency content from said visual image and to combine said extracted high spatial frequency content from said visual image with said IR image, wherein a resolution for the visual image and the IR
image are substantially the same, to generate a combined image.
25. The imaging device of the preceding claim, further comprising a processor adapted for performing the steps or functions of any of claims 2-21.
Applications Claiming Priority (5)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US12/766,739 US8520970B2 (en) | 2010-04-23 | 2010-04-23 | Infrared resolution and contrast enhancement with fusion |
| US12/766,739 | 2010-04-23 | ||
| US201161473207P | 2011-04-08 | 2011-04-08 | |
| US61/473,207 | 2011-04-08 | ||
| PCT/EP2011/056432 WO2011131758A1 (en) | 2010-04-23 | 2011-04-21 | Infrared resolution and contrast enhancement with fusion |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CA2797054A1 true CA2797054A1 (en) | 2011-10-27 |
| CA2797054C CA2797054C (en) | 2018-07-17 |
Family
ID=44278715
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CA2797054A Active CA2797054C (en) | 2010-04-23 | 2011-04-21 | Infrared resolution and contrast enhancement with fusion |
Country Status (3)
| Country | Link |
|---|---|
| KR (1) | KR101773887B1 (en) |
| CN (1) | CN102334141B (en) |
| CA (1) | CA2797054C (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109478315A (en) * | 2016-07-21 | 2019-03-15 | 前视红外系统股份公司 | Blending image optimization system and method |
| CN111080554A (en) * | 2019-12-20 | 2020-04-28 | 成都极米科技股份有限公司 | Method and device for enhancing subtitle area in projection content and readable storage medium |
Families Citing this family (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR200457457Y1 (en) | 2009-07-03 | 2011-12-20 | 주식회사 일광산업 | LCD Monitor Installing Equipment with Automatic Opening Cover |
| CN104364800A (en) * | 2012-03-30 | 2015-02-18 | 前视红外系统股份公司 | Facilitating analysis and interpretation of associated visible light and infrared (IR) image information |
| CN105009568B (en) * | 2012-12-21 | 2018-12-18 | 菲力尔系统公司 | For handling the system of visible spectrum image and infrared image, method and the readable medium of non-volatile machine |
| WO2016205419A1 (en) * | 2015-06-15 | 2016-12-22 | Flir Systems Ab | Contrast-enhanced combined image generation systems and methods |
| KR102590900B1 (en) * | 2018-08-27 | 2023-10-19 | 엘지이노텍 주식회사 | Image processing apparatus and image processing method |
| EP3704668A4 (en) | 2018-12-17 | 2021-04-07 | SZ DJI Technology Co., Ltd. | Image processing method and apparatus |
| KR20210043933A (en) * | 2019-10-14 | 2021-04-22 | 엘지이노텍 주식회사 | Image Processing Apparatus and Image Processing Method |
| KR102341471B1 (en) * | 2019-11-25 | 2021-12-21 | 김종원 | Method and aooaratus for object regobnition using thermal imaging sensor and imaging sensor |
| KR102257752B1 (en) * | 2020-05-14 | 2021-05-31 | 인천대학교 산학협력단 | Artificial Intelligence Based Image Fusion Apparatus and Method for Fusing Infrared and Visible Image |
| CN112449095A (en) * | 2020-11-12 | 2021-03-05 | Oppo广东移动通信有限公司 | Image processing method and device, electronic equipment and readable storage medium |
Family Cites Families (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| DK0973137T3 (en) * | 1998-07-06 | 2003-05-05 | Siemens Building Tech Ag | motion detector |
| JP2005031800A (en) * | 2003-07-08 | 2005-02-03 | Mitsubishi Electric Corp | Thermal image display device |
| JP2005173879A (en) | 2003-12-10 | 2005-06-30 | Mitsubishi Electric Corp | Fused image display device |
| US7620265B1 (en) * | 2004-04-12 | 2009-11-17 | Equinox Corporation | Color invariant image fusion of visible and thermal infrared video |
| JP2005338359A (en) | 2004-05-26 | 2005-12-08 | Constec Engi Co | Imaging unit |
| CN100557633C (en) * | 2007-12-18 | 2009-11-04 | 西安电子科技大学 | Multisource image anastomosing method based on pectination ripple and Laplace tower decomposition |
| CN101404084A (en) * | 2008-11-14 | 2009-04-08 | 哈尔滨工业大学 | Infrared image background suppression method based on Wavelet and Curvelet conversion |
-
2011
- 2011-04-21 CA CA2797054A patent/CA2797054C/en active Active
- 2011-04-21 CN CN201180000582.8A patent/CN102334141B/en active Active
- 2011-04-21 KR KR1020127030587A patent/KR101773887B1/en active IP Right Grant
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109478315A (en) * | 2016-07-21 | 2019-03-15 | 前视红外系统股份公司 | Blending image optimization system and method |
| CN111080554A (en) * | 2019-12-20 | 2020-04-28 | 成都极米科技股份有限公司 | Method and device for enhancing subtitle area in projection content and readable storage medium |
| CN111080554B (en) * | 2019-12-20 | 2023-08-04 | 成都极米科技股份有限公司 | Method and device for enhancing subtitle region in projection content and readable storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN102334141B (en) | 2015-05-20 |
| KR20130054281A (en) | 2013-05-24 |
| CA2797054C (en) | 2018-07-17 |
| CN102334141A (en) | 2012-01-25 |
| KR101773887B1 (en) | 2017-09-12 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CA2797054A1 (en) | Infrared resolution and contrast enhancement with fusion | |
| EP2570988A3 (en) | Resolution and contrast enhancement with fusion in IR images | |
| EP3087730B1 (en) | Method for inverse tone mapping of an image | |
| CA2927295C (en) | Method and device for processing a video stream in a video camera | |
| US8817339B2 (en) | Handheld device document imaging | |
| US20140340515A1 (en) | Image processing method and system | |
| WO2014037953A3 (en) | Digital system for surgical video capturing and display | |
| WO2017101489A1 (en) | Method and device for image filtering | |
| US20140355902A1 (en) | Image processing method with detail-enhancing filter with adaptive filter core | |
| US9002127B2 (en) | Image dynamic range compression system, method and program | |
| EP2677732A3 (en) | Method, apparatus and computer program product for capturing video content | |
| WO2013079778A3 (en) | Method, apparatus and computer program product for capturing images | |
| KR101577918B1 (en) | Local area contrast enhancement | |
| JP2011041089A5 (en) | ||
| EP2262255A3 (en) | Image processing apparatus and image processing method | |
| WO2012040827A3 (en) | Interactive input system having a 3d input space | |
| EP2677497A3 (en) | Method and system of spacial visualisation of objects and a platform control system included in the system, in particular for a virtual fitting room | |
| WO2013126715A3 (en) | Vehicle camera system with image manipulation | |
| WO2014170670A3 (en) | Imaging apparatus and method | |
| WO2012003483A3 (en) | A method and apparatus for video processing for improved video compression | |
| JP2013120550A5 (en) | ||
| JP2011191860A5 (en) | Imaging apparatus, image processing apparatus, imaging processing method, and program | |
| JP2010171940A5 (en) | ||
| CN108510447B (en) | Image fusion method and device | |
| EP2843938A3 (en) | Method, apparatus and computer program product for sensing of visible spectrum and near infrared spectrum |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| EEER | Examination request |
Effective date: 20160201 |