CN106408538A - Motion blurred image restoration method based on array image - Google Patents
Motion blurred image restoration method based on array image Download PDFInfo
- Publication number
- CN106408538A CN106408538A CN201610850978.6A CN201610850978A CN106408538A CN 106408538 A CN106408538 A CN 106408538A CN 201610850978 A CN201610850978 A CN 201610850978A CN 106408538 A CN106408538 A CN 106408538A
- Authority
- CN
- China
- Prior art keywords
- image
- array
- motion blur
- restoration method
- image restoration
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 26
- 230000004927 fusion Effects 0.000 claims abstract 2
- 238000005516 engineering process Methods 0.000 claims description 5
- 238000011084 recovery Methods 0.000 claims description 4
- 238000010276 construction Methods 0.000 claims 1
- 238000004377 microelectronic Methods 0.000 claims 1
- 230000000694 effects Effects 0.000 abstract description 3
- 230000015556 catabolic process Effects 0.000 description 6
- 238000006731 degradation reaction Methods 0.000 description 5
- 230000009466 transformation Effects 0.000 description 4
- 241000272194 Ciconiiformes Species 0.000 description 2
- 238000006243 chemical reaction Methods 0.000 description 2
- 238000012634 optical imaging Methods 0.000 description 2
- 230000000007 visual effect Effects 0.000 description 2
- 239000000654 additive Substances 0.000 description 1
- 230000000996 additive effect Effects 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 238000005259 measurement Methods 0.000 description 1
- 229910052704 radon Inorganic materials 0.000 description 1
- SYUHGPGVQRZVTB-UHFFFAOYSA-N radon atom Chemical compound [Rn] SYUHGPGVQRZVTB-UHFFFAOYSA-N 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/73—Deblurring; Sharpening
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/10—Image enhancement or restoration using non-spatial domain filtering
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/50—Image enhancement or restoration using two or more images, e.g. averaging or subtraction
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10004—Still image; Photographic image
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20048—Transform domain processing
- G06T2207/20052—Discrete cosine transform [DCT]
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20172—Image enhancement details
- G06T2207/20201—Motion blur correction
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20212—Image combination
- G06T2207/20221—Image fusion; Image merging
Landscapes
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Image Processing (AREA)
Abstract
The invention discloses a motion blurred image restoration method based on array images. The motion blurred image restoration method comprises the steps of: acquiring array images of a moving object at a moment by using array lenses with the same focal length; performing multi-scale feature registration on the acquired array images by taking the center image as a reference image; carrying out image fusion based on wavelet on the array images; and finally removing residual blurred information by adopting a Lucy- Richardson algorithm, thereby achieving motion blurred image restoration with good effect. The motion blurred image restoration method based on array image is effectively verified on 3*3 array lenses, and can extend the application range of mobile equipment in the field of image restoration.
Description
Technical field
The invention belongs to technical field of image processing is and in particular to a kind of motion blur image restoration based on array image
Method, can be used for the recovery of blurred picture.
Background technology
Image restoration is exactly how research restores true picture from the degraded image of gained, or say be study how from
It is finally inversed by the information about real goal in the information obtaining.Image is caused to go bad the reason make image blurring in other words a lot,
Wherein cause due to there is certain relative motion between subject and camera image blurring then be referred to as motion blur figure
Picture.In motion blur image, scenery is unintelligible, is difficult to obtain the information of interested position.Motion blur image in daily life
Generally existing, the real life giving people brings a lot of inconvenience.In recent years, being recovered into of motion blur image currently calculates
One of machine vision technique hot issue.For this problem, many Chinese scholars are from different angles with different sides
Method is furtherd investigate.The method of the motion blur image restoration proposing at present is broadly divided into two big class：Spatial domain method and frequency domain
Method.Algorithms of different and method in different situations, have different recovery effects.And these algorithms are all before supposing
Propose under the conditions of carrying, and actual blurred picture, not necessarily disclosure satisfy that these algorithm premises, or only meet it
Part premise.Image restoration key is the process it is to be understood that image degradation, that is, it is to be understood that the image after image degradation is restored
Process and there is realistic meaning very much.The purpose of image restoration is exactly the priori according to image degradation, finds a kind of corresponding
The method of inverse process processing image, thus obtain the quality of original image as far as possible, to meet the requirement of human visual system, with
Just view and admire, identify or other application needs.
Motion blur image is a kind of form of image degradation.Motion blur is gone to be exactly that degraded image is restored.Figure
As restoring certain priori being exactly to utilize in degradation phenomena, the image degenerated is restored.Realize removing motion blur
Key is intended to understand motion blur core, sets up the Mathematical Modeling removing motion blur accordingly, and inverse according to motion blur
Process is repaired to image.Mode due to producing image blurring has many kinds, generally adopts unified Mathematical Modeling to this
Process is described.General Mathematical Modeling is described as formula (1).
G (x, y)=h (x, y) * f (x, y)+n (x, y) (1)
In formula (1), g (x, y) is blurred picture, and h (x, y) is point spread function, and f (x, y) is original image, and n (x, y) is
Additive noise, " * " is spatial convolution operation.Fourier transformation is carried out to formula (1) formula (2) can be obtained.
G (u, v)=H (u, v) * F (u, v)+N (u, v) (2)
Wherein G (u, v), H (u, v), F (u, v), N (u, v) be respectively g (x, y) in formula (1), h (x, y), f (x, y), n (x,
Y) Fourier transformation, by this step computing just image from spatial transform to frequency domain.
In addition, it is the light field technology of Stanford University Ren Ng proposition in 2005 that array lens are initially conceived to originate, its core
The heart is to have added a microlens array between main lens and sensor, it is possible to achieve first takes pictures and focuses afterwards.Lytro public affairs in 2007
Department releases first light-field camera in the world using this technology, and different from traditional camera, it can be with numerous attributes of recording light.And
Before Lytro, Germany Raytrix company also produce light-field camera, Raytrix 3 d light fields camera have in real time the long depth of field and
Feature not out of focus, is generally used for science and technical grade purposes, 3D stereo display technique.Raytrix company camera and Lytro
Camera is the same, and by main lens, microlens array and detector three part form its optical imaging system.But Lytro and Raytrix
All added with microlens array in the light-field camera optical imaging system of company, size is big, and thickness is thick to be moved it is impossible to be used for mobile phone etc.
On equipment.For overcoming this defect, 2011, Pelican company released array camera and does not add microlens array, its array
Formula camera lens is made up of 16 pieces of sub- camera lenses of 4 × 4 arrangements, once shoots and obtains 16 width monochrome images.Powerful being in of this camera
Focus afterwards in realizing first taking pictures, the later stage can complete 3-D view by images match, splicing etc. and reconstruct and show.We
Research array camera lens similar with Pelican company, the recovery of achievable motion blur image, image measurement, again focus, surpass
Resolution reconstruction etc..
Content of the invention
The technical problem to be solved in the present invention is：Go in motion blur method in traditional, the estimation of fuzzy core is to pass
Important, clear information is instead released according to fuzzy core.The estimation of fuzzy core is directly had a strong impact on the effect of deblurring, final shadow
Ring the visual effect of image.Method according to the present invention first passes through image co-registration and obtains more visible image, by Lucy-
Richardson algorithm removes remaining fuzzy message.So obtain that restored image information is more rich, details obtains than direct deblurring
The image arriving is apparent.The technical solution adopted in the present invention is：
1) registration based on Analysis On Multi-scale Features is carried out to array image；
2) image co-registration based on small echo is carried out to array image；
3) Lucy-Richardson algorithm is used to remove remaining fuzzy message.
Brief description
Fig. 1 flow chart of the present invention
The array lens that Fig. 2 present invention uses
The array image that Fig. 3 present invention uses
Based on the array image after Analysis On Multi-scale Features registration in Fig. 4 present invention
Image after merging in Fig. 5 present invention
The final image restoring in Fig. 6 present invention
Specific embodiment
For making the object, technical solutions and advantages of the present invention become more apparent, in conjunction with the array of figure being related in the present invention
Picture, the present invention is described in more detail.
Accompanying drawing 2 show and shoots, using array lens, 3*3 array image such as accompanying drawing 3 institute that the fan obtaining rotating obtains
Show, this group pattern image has certain parallax, and in array image, the fuzzy region of every subgraph is all different.Battle array is organized based on this
The specific implementation method of the motion blur image restoration method of row image is as follows：
1) registration based on Analysis On Multi-scale Features is carried out to array image；
On the basis of we take the center image (the 5th width image) of array image, image carries out registration.Divided using wavelet transformation
Solution original image, detects corner location on each yardstick, then the angle point on little yardstick is mapped on the image of large scale,
And then the corner location of acquisition original image, finally image is rebuild, obtained the array image after registration, as accompanying drawing 4 institute
Show.
2) image co-registration based on small echo is carried out to array image；
Using wavelet transform, width picture breakdown each in 3*3 array image to be fused is become 4 width subgraphs, so
4 width subgraphs of the array image to be fused from 9 are carried out merging the fused images obtaining this grade afterwards in every one-level,
Carry out inverse transformation and obtain final fused images, as shown in Figure 5.
3) Lucy-Richardson algorithm is used to remove remaining fuzzy message.
First it is -84 ° with the motion blur angle that fused image is tried to achieve in Radon conversion, motion blur length is 4 pictures
Plain distance, then remove remaining fuzzy message with Lucy-Richardson algorithm, the image finally being restored, as accompanying drawing 6 institute
Show.
The above, the only specific embodiment in the present invention, but protection scope of the present invention is not limited thereto, and appoints
What be familiar with the people of this technology disclosed herein technical scope in it will be appreciated that the conversion expected or replacement, all should cover
Within the protection domain of claims of the present invention.
Claims (4)
1. with focal length array lens module by magnificent sky science and technology (Kunshan) Electronics Co., Ltd. and the limited public affairs of Ge Ke microelectronics (Shanghai)
Department provides, and is made up of 9 pieces of sub- camera lenses of 3 × 3 arrangements, once shoots and obtain nine width color motion blurred pictures.Used here as battle array
The array image that row lens shooting obtains is essential features, and the construction of array lens and assembly are dispensable.
2. same focal length array lens according to claim 1 shoot motion blur image, and algorithm characteristics include：
1) registration based on Analysis On Multi-scale Features is carried out to array image；
2) image co-registration based on small echo is carried out to array image；
3) Lucy-Richardson algorithm is used to remove remaining fuzzy message.
3. same focal length array lens motion blur image restoration method according to claim 2 is it is characterised in that by array
Image carries out image co-registration, realizes the recovery of motion blur image.Particularly, there is parallax each image in array image here
In fuzzy degree and position all different, after image co-registration, by each image clearly partial fusion become a width more clear
Clear image, is removing remaining fuzzy message using Lucy-Richardson algorithm, is obtaining definition better image.
4. the motion blur image restoration method based on array lens according to claim 2, different from based on single width figure
The restored method of picture, used herein is array image, and the estimation of motion blur core is more accurate.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610850978.6A CN106408538A (en) | 2016-09-27 | 2016-09-27 | Motion blurred image restoration method based on array image |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610850978.6A CN106408538A (en) | 2016-09-27 | 2016-09-27 | Motion blurred image restoration method based on array image |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN106408538A true CN106408538A (en) | 2017-02-15 |
Family
ID=57997677
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610850978.6A Pending CN106408538A (en) | 2016-09-27 | 2016-09-27 | Motion blurred image restoration method based on array image |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106408538A (en) |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR100860967B1 (en) * | 2007-04-16 | 2008-09-30 | 삼성전자주식회사 | Apparatus and method for removing motion blur of image |
| CN104952048A (en) * | 2015-06-09 | 2015-09-30 | 浙江大学 | Focus stack photo fusing method based on image reconstruction |
-
2016
- 2016-09-27 CN CN201610850978.6A patent/CN106408538A/en active Pending
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR100860967B1 (en) * | 2007-04-16 | 2008-09-30 | 삼성전자주식회사 | Apparatus and method for removing motion blur of image |
| CN104952048A (en) * | 2015-06-09 | 2015-09-30 | 浙江大学 | Focus stack photo fusing method based on image reconstruction |
Non-Patent Citations (1)
| Title |
|---|
| 邹建成等: "基于微阵列相机运动模糊图像的复原", 《北方工业大学学报》 * |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110335343B (en) | Human body three-dimensional reconstruction method and device based on RGBD single-view-angle image | |
| CN102595171B (en) | Imaging method and imaging system of dynamic optical fields of multichannel space-time coding apertures | |
| CN111080709B (en) | Multispectral stereo camera self-calibration algorithm based on track feature registration | |
| Shimizu et al. | Super-resolution from image sequence under influence of hot-air optical turbulence | |
| US20220148297A1 (en) | Image fusion method based on fourier spectrum extraction | |
| CN106127680B (en) | 720-degree panoramic video fast browsing method | |
| Sheng et al. | Depth-aware motion deblurring using loopy belief propagation | |
| CN106791273B (en) | A kind of video blind restoration method of combination inter-frame information | |
| CN103337094A (en) | Method for realizing three-dimensional reconstruction of movement by using binocular camera | |
| CN114972061B (en) | Method and system for denoising and enhancing dim light video | |
| CN111583386B (en) | Multi-view human body posture reconstruction method based on label propagation algorithm | |
| CN106469442A (en) | A kind of enhancement method of low-illumination image based on array image | |
| Zhang et al. | Multiscale-vr: Multiscale gigapixel 3d panoramic videography for virtual reality | |
| Sharma et al. | A flexible architecture for multi-view 3DTV based on uncalibrated cameras | |
| Liu et al. | Self-adaptively learning to demoiré from focused and defocused image pairs | |
| Huang et al. | Removing reflection from a single image with ghosting effect | |
| Liang et al. | Coherent event guided low-light video enhancement | |
| Fu et al. | Low-light raw video denoising with a high-quality realistic motion dataset | |
| Yan et al. | Single image reflection removal from glass surfaces via multi-scale reflection detection | |
| CN105913395B (en) | A kind of observation of moving target and smear restoration method | |
| Brzeszcz et al. | Real‐time construction and visualisation of drift‐free video mosaics from unconstrained camera motion | |
| CN103873773A (en) | Primary-auxiliary synergy double light path design-based omnidirectional imaging method | |
| Bae et al. | 5d light field synthesis from a monocular video | |
| Cui et al. | Multi-frame motion deblurring using coded exposure imaging with complementary fluttering sequences | |
| CN106408538A (en) | Motion blurred image restoration method based on array image |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| TA01 | Transfer of patent application right | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20190715 Address after: 100144 Beijing City, Shijingshan District Jin Yuan Zhuang Road No. 5 Applicant after: NORTH CHINA University OF TECHNOLOGY Address before: 100144 Beijing City, Shijingshan District Jin Yuan Zhuang Road No. 5 Science College of North China University of Technology Applicant before: Zou Jiancheng |
|
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20170215 |