CN105069753A - Mobile-terminal-oriented method for restoring blurred image caused by jitter - Google Patents

Mobile-terminal-oriented method for restoring blurred image caused by jitter Download PDF

Info

Publication number
CN105069753A
CN105069753A CN201510459486.XA CN201510459486A CN105069753A CN 105069753 A CN105069753 A CN 105069753A CN 201510459486 A CN201510459486 A CN 201510459486A CN 105069753 A CN105069753 A CN 105069753A
Authority
CN
China
Prior art keywords
axis
camera
shake
psf
image
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201510459486.XA
Other languages
Chinese (zh)
Other versions
CN105069753B (en
Inventor
马杰
刘江伟
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Huazhong University of Science and Technology
Original Assignee
Huazhong University of Science and Technology
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Huazhong University of Science and Technology filed Critical Huazhong University of Science and Technology
Priority to CN201510459486.XA priority Critical patent/CN105069753B/en
Publication of CN105069753A publication Critical patent/CN105069753A/en
Application granted granted Critical
Publication of CN105069753B publication Critical patent/CN105069753B/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Landscapes

  • Image Processing (AREA)
  • Studio Devices (AREA)

Abstract

The invention discloses a mobile-terminal-oriented method for restoring a blurred image caused by jitter, and includes: (1) obtaining a blurred image when a mobile terminal jitters; (2) obtaining an output sequence of a gyroscope related with a jitter trajectory of the mobile terminal within opening time of a camera shutter; (3) obtaining a rotation angle of the mobile terminal after performing integration processing on the output sequence, and performing coordinate mapping on the rotation angle, thereby obtaining a jitter PSF template; and (4) according to the blurred image and the jitter PSF template, adopting an image restoration algorithm to perform restoration processing, thereby obtaining a restored image. The mobile-terminal-oriented method for restoring the blurred image caused by jitter estimates the jitter trajectory of a built-in camera of the mobile terminal within the opening time of the shutter according to the built-in gyroscope of the mobile terminal; integration is performed on the output sequence value of the gyroscope to obtain the rotation angle of the mobile phone, and coordinates are mapped to an image plane coordinate system, thereby obtaining the jitter PSF template, and the blurred image can be effectively restored by utilization of the PSF template and the corresponding image restoration algorithm.

Description

A kind of shake Restoration method of blurred image of facing moving terminal
Technical field
The invention belongs to technical field of image processing, more specifically relate to a kind of shake Restoration method of blurred image of facing moving terminal.
Background technology
The built-in camera of mobile terminal, in pictures taken process, inevitably causes image to produce fuzzy due to the shake of a variety of causes, and time most, moment has non-repeated, therefore carries out recovery to the blurred picture of shooting and is just extremely necessary.The all built-in gyroscope of mobile terminal of the overwhelming majority on market, this makes to obtain the movable information of mobile terminal within the camera shutter opening time becomes possibility, the shake PSF template in this time just can be obtained according to the movable information of mobile terminal, then according to Image Restoration Algorithm and above-mentioned shake PSF template, restoration disposal is carried out to this blurred picture, just can obtain restored image.
Image restoration is extremely important in image processing field, its recuperation is actually a kind of estimation procedure, builds corresponding restoration model according to image blurring factor, thus takes corresponding Image Restoration Algorithm to restore blurred picture, improve the sharpness of image, improve its visual effect.
Blur image restoration is study hotspot and the difficult point of image processing field always, whether known according to PSF, blur image restoration is divided into blind recovery and non-blind to restore, and non-blind is restored and compared the estimation procedure that blind recovery mainly has more PSF, the difficult point of this image restoration often.Have the method for a lot of extracting directly PSF from blurred picture at present, this class methods complexity is high, and computing time is longer, and extraction effect affects comparatively large by picture material, adaptability is general.
Summary of the invention
For the defect of prior art, the invention provides a kind of shake Restoration method of blurred image of facing moving terminal, its object is to utilize the gyroscope of terminal built-in to obtain PSF, then apply it in non-blind restoration algorithm and blurred picture is restored, improve the sharpness of image.
The invention provides a kind of shake Restoration method of blurred image of facing moving terminal, comprise the steps:
(1) blurred picture during width mobile terminal shake is obtained;
(2) obtained in the camera shutter opening time by gyroscope, shake the relevant output sequence of track to mobile terminal;
Wherein, output sequence is m × n group data, and data layout is (G xi, G yi, G zi, t i), m is gyrostatic sample frequency, and n is the shutter opening time of camera, and subscript i represents output sequence number, and value is 1,2 ..., m × n, G xirepresent i-th group of angular velocity rotated around X-axis, G yirepresent i-th group of angular velocity rotated around Y-axis, G zirepresent i-th group of angular velocity rotated around Z axis, t irepresent the sampling instant of i-th group of data, X-axis is the optical axis of camera, and Y-axis is the longitudinal axis of picture plane, and Z axis is the transverse axis of picture plane;
(3) Integral Processing is carried out to described output sequence, obtain the rotational angle of camera Y-axis and Z axis in its place XYZ coordinate system, and described rotational angle is carried out virtual borderlines, obtain shake PSF template;
(4) according to described blurred picture and described shake PSF template, adopt Image Restoration Algorithm to carry out restoration disposal, obtain restored image.
Further, the step obtaining shake PSF template is specially:
(1) initialization empty chain table L, makes the initial value of output sequence i be 1;
(2) Integral Processing is carried out to described output sequence, obtain camera t within the shutter opening time itime be engraved in the rotational angle θ of Y-axis in its place XYZ coordinate system yiwith the rotational angle θ of Z axis zi;
(3) by the rotational angle θ of camera in Y-axis yiwith the rotational angle θ of Z axis zibe mapped in photo coordinate system, obtain t in picture plane ia location point (y in moment i, z i, △ t i), and it is added in chained list L;
Wherein, y ifor t ithe deviation post of moment Y-axis, z ifor t ithe deviation post of moment Z axis, △ t ifor camera attitude is in the retention time of this position, y i=h × tan (θ yi), z i=h × tan (θ zi), △ t i=t i+1-t i, h represents camera lens focal length;
(4) judge whether i equals m × n, if so, then enter step (5); If not, then i adds 1, and is back to step (2);
(5) y is calculated imaximum absolute value value and z imaximum absolute value value | z | m a x = MAX i = 1 m × n ( | z i | ) ;
(6) initialization one (2 × | y| max+ 1) OK, (2 × | z| max+ 1) the full 0 matrix M arranged, and make the initial value of data sequence number j be 1;
(7) the jth group data (y in chained list L is taken out j, z j, △ t j), by (y in matrix M j+ | y| max) row (z j+ | z| max) element value that arranges adds △ t j;
(8) judge whether j equals m × n, if so, then enter step (9); If not, then j adds 1, and is back to step (7);
(9) matrix M is normalized, namely obtains shake PSF template.
The present invention's advantage is compared with prior art:
(1) the present invention is in order to improve the sharpness of blurred picture, carries out non-blind restoration disposal to it, can estimate the PSF of blurred picture; Gyroscope output sequence is utilized accurately to calculate the movement locus of camera within the shutter opening time particularly, then the PSF of blurred picture just can be estimated by virtual borderlines, again this PSF is applied in non-blind restoration algorithm and restoration disposal is carried out to mould lake image, obtain restored image, thus improve the sharpness of image.
(2) the present invention is only relevant with the state of terminal camera, and has nothing to do with the content of captured picture; And existing PSF extracting method is mostly after the content analyzing blurred picture, according to priori PSF estimated and extract, these method calculated amount are large and usable range has limitation more, the present invention only needs the PSF carrying out blurred picture according to the output sequence of terminal camera attitudes vibration to extract, have nothing to do with content of shooting, applicability is strong.
(3) the gyrostatic output sequence that the present invention is built-in according to mobile terminal directly calculates the PSF of blurred picture, and these data volumes are more limited, and therefore the present invention's complexity in PSF extraction is very low, and calculated amount is very little.
(4) pure digi-tal process, does not need to add extra hardware, with low cost.Can be found out by description above, the present invention only gyroscope built-in according to mobile terminal just can obtain desirable result, recovery operation pure digi-tal, does not need other auxiliary hardware devices completely, with low cost, has practical value widely.
Accompanying drawing explanation
Fig. 1 is the camera XYZ coordinate system figure that the embodiment of the present invention provides, and wherein X-axis is the optical axis of camera, and Y-axis is the longitudinal axis of picture plane, and Z axis is the transverse axis of picture plane;
Fig. 2 is the recovery process flow diagram that the embodiment of the present invention provides;
Fig. 3 is the coordinate graph of a relation of the output sequence that provides of the embodiment of the present invention to picture plane;
Fig. 4 is the extraction process flow diagram of the PSF that the embodiment of the present invention provides;
Fig. 5 is the actual recovery effect comparison diagram that the embodiment of the present invention provides, wherein figure (a), (b) are two width blurred pictures, figure (c) is the recovery effect figure of figure (a), schemes the recovery effect figure that (d) is figure (b).
Embodiment
In order to make object of the present invention, technical scheme and advantage clearly understand, below in conjunction with drawings and Examples, the present invention is further elaborated.Should be appreciated that specific embodiment described herein only in order to explain the present invention, be not intended to limit the present invention.
The shake of camera is divided into translation and rotation, and the impact of translation on picture quality is less, can not consider, rotating the impact of picture quality very large, is cause image blurring main cause.Fig. 1 is the camera XYZ coordinate system figure that the present embodiment provides, and wherein X-axis is the optical axis of camera, and Y-axis is the longitudinal axis of picture plane, and Z axis is the transverse axis of picture plane.The rotation of camera is exactly the rotation around X-axis, Y-axis and Z axis.And smaller around the impact of rotation on imaging of X-axis, so also can not consider.
The invention provides a kind of shake Restoration method of blurred image of facing moving terminal, the shake PSF template in the camera shutter opening time can be estimated, and carry out by this PSF template the Digital Rehabilitation shaking blurred picture.The gyroscope that the present invention utilizes mobile terminal built-in obtains the output sequence that camera rotates around described X-axis, Y-axis and Z axis, then the shake track of camera within the shutter opening time is estimated, the PSF of blurred picture is obtained again by virtual borderlines, finally this PSF is applied in Image Restoration Algorithm and digital restoration is carried out to blurred picture, thus improve the sharpness of image, improve its visual effect.Because camera and gyroscope are all built in mobile terminal, therefore camera and gyroscope have identical shake track, so can obtain the movable information of camera with the output sequence of gyroscope within the camera shutter opening time.
In the shake Restoration method of blurred image of facing moving terminal provided by the invention, finally need shake PSF template to be applied in Image Restoration Algorithm and could to restore blurred picture, the Image Restoration Algorithm that the present embodiment is selected is Richardson-Lucy algorithm.Fig. 2 is the recovery process flow diagram that the embodiment of the present invention provides, and specifically comprises the steps:
(1) blurred picture during width mobile terminal shake is obtained;
(2) camera is obtained within the shutter opening time around the output sequence that described X-axis, Y-axis and Z axis rotate by gyroscope.
(3) Integral Processing is carried out to above-mentioned output sequence, obtain the rotational angle of each moment camera Y-axis and Z axis in the shutter opening time.
(4) rotational angle of trying to achieve in step (3) is mapped to photo coordinate system by coordinate conversion, obtains shake PSF template.
(5) Richardson-Lucy algorithm is utilized to restore blurred picture.
Richardson-Lucy restoration algorithm is a kind of Restoration method of blurred image adopting iterative manner, its core is the recovery utilizing the high s/n ratio PSF template obtained to carry out blurred picture, obtain the PSF of blurred picture in step (4), thus utilize Richardson-Lucy algorithm can realize the recovery of the blurred picture to mobile terminal shooting.
For optical imaging system, the system that PSF is defined as using two-dimensional impact function as input exports.Wherein two-dimensional impact function is defined as form as follows:
δ ( x , y ) = { ∞ , x 2 + y 2 = 0 0 , x 2 + y 2 ≠ 0 - - - ( 1 )
The shake of broad sense is defined as the random offset that optical imaging system PSF center changes generation in time.Concerning point target, shake to show as in image target picture point in each departing from its ideal position in efficiently sampling moment, and that is shake is the motion artifacts that a kind of Random Effect causes, and shows as the random offset of target location in picture frame.Discussed herein is dithered as sensu lato shake, and it should be noted that when the imaging camera shutter opening time enough in short-term, shake can not cause the random motion of PSF in picture frame, that is shakes the spatial distribution characteristic not affecting instantaneous PSF.Do not consider to defocus etc. that reason causes is image blurring, the image of shake is clearly at sampling instances, but time averaging result can cause the fuzzy of image.
Suppose that the opening and closing of shutter time used is very short, so optical imaging procedures can not be subject to the interference of flating.Original image f (x, y), by the effect of degenrate function H, obtains blurred picture g (x, y):
g(x,y)=H[f(x,y)](2)
If degenrate function H is linear, space invariance, then degraded image is provided by following formula in spatial domain:
g(x,y)=h(x,y)*f(x,y)(3)
Wherein h (x, the y) space representation that is degenrate function, also claim PSF, " * " represents convolution, and carrying out Fourier transform to above formula both sides can obtain
G(u,v)=H(u,v)F(u,v)(4)
Wherein (u, v) is frequency domain coordinates, G (u, v), H (u, v) and F (u, v) corresponding blurred picture g (x respectively, y), the frequency domain value of degenrate function h (x, y) and original image f (x, y).
In step (2), obtain mobile terminal around the angular velocity that described X-axis, Y-axis and Z axis rotate within the shutter opening time by gyroscope, output sequence is m × n group data, and data layout is (G xi, G yi, G zi, t i), m is gyrostatic sample frequency, and n is the shutter opening time of camera, and subscript i represents output sequence number, and value is 1,2 ..., m × n, G xirepresent i-th group of angular velocity rotated around X-axis, G yirepresent i-th group of angular velocity rotated around Y-axis, G zirepresent i-th group of angular velocity rotated around Z axis, t irepresent the sampling instant of i-th group of data.
In step (3), camera is less to Imaging around the rotation of X, so can not consider.Fig. 3 is the coordinate graph of a relation of the output sequence that provides of the embodiment of the present invention to picture plane, θ in this figure y, θ zbe the rotational angle of camera Y-axis, Z axis respectively, visible camera is the rotational angle θ of Z axis around Y-axis Effect of Rotation z, camera is the rotational angle θ of Y-axis around Z axis Effect of Rotation y.Definition θ yit ithe rotational angle of moment Y-axis, θ zit ithe rotational angle of moment Z axis, being calculated as follows of they
θ y i = Σ j = 1 i ( G z j + 1 + G z j ) ( t j + 1 - t j ) 2 θ z i = Σ j = 1 i ( G y j + 1 + G y j ) ( t j + 1 - t j ) 2 - - - ( 5 )
In step (4), according to above-mentioned angle by virtual borderlines to photo coordinate system, obtain shake PSF template.In Fig. 3, a and b is respectively width and the length of shooting image, and h is camera lens focal length, y and z is respectively impulse function at θ yand θ zin the deviation post as Y-axis in plane YOZ and Z axis under impact.Definition y ifor t ithe deviation post of moment Y-axis, z ifor t ithe deviation post of moment Z axis, △ t ifor camera attitude is in the retention time of this position.Picture plane YOZ mid point (y i, z i, △ t i) computing formula as follows
y i = h × tan ( θ y i ) z i = h × tan ( θ z i ) Δt i = t i + 1 - t i - - - ( 6 )
Initialization empty chain table L, by point (y i, z i, △ t i) add to wherein, each group of Data duplication above-mentioned steps in the output sequence that gyroscope is obtained.After end, calculate y imaximum absolute value value | y | m a x = MAX i = 1 m × n ( | y i | ) And z imaximum absolute value value | z | m a x = MAX i = 1 m × n ( | z i | ) , Reinitialize one (2 × | y| max+ 1) OK, (2 × | z| max+ 1) the full 0 matrix M arranged, takes out the point (y in chained list L successively j, z j, △ t j), wherein j represents the data sequence number in chained list L, and value is 1,2 ..., m × n, and by (y in matrix M j+ | y| max) row (z j+ | z| max) element value that arranges adds △ t j.After above-mentioned steps completes, matrix M is normalized, namely obtains shake PSF template.
Fig. 4 is the extraction process flow diagram of above-mentioned shake PSF template, specifically comprises the following steps:
(1) initialization empty chain table L, makes output sequence i be 1;
(2) Integral Processing is carried out to described output sequence, obtain camera t within the shutter opening time itime be engraved in the rotational angle θ of Y-axis in its place XYZ coordinate system yiwith the rotational angle θ of Z axis zi;
(3) by the rotational angle θ of camera in Y-axis yiwith the rotational angle θ of Z axis zibe mapped in photo coordinate system, obtain t in picture plane ilocation point (the y in moment i, z i, △ t i), and it is added in chained list L;
(4) judge whether i equals m × n, if so, then enter step (5); If not, then i adds 1, and is back to step (2);
(5) y is calculated imaximum absolute value value | y| maxand z imaximum absolute value value | z| max;
(6) initialization one (2 × | y| max+ 1) OK, (2 × | z| max+ 1) the full 0 matrix M arranged, and make data sequence number j equal 1;
(7) the jth group data (y in chained list L is taken out j, z j, △ t j), by (y in matrix M j+ | y| max) row (z j+ | z| max) element value that arranges adds △ t j;
(8) judge whether j equals m × n, if so, then enter step (9); If not, then j adds 1, and is back to step (7);
(9) matrix M is normalized, namely obtains shake PSF template.
In the step (5) of restoring flow process, Richardson-Lucy algorithm is specially:
Richardson-Lucy algorithm is a kind of algorithm for blur image restoration jointly proposed by Richardson and Lucy.At first for the lens deviation corrected due to Hubble Telescope cause image blurring, this algorithm is a kind of widely used Image Restoration Algorithm at present.
The basic thought of Richardson-Lucy algorithm makes to export a maximum likelihood value for ideal data by continuous iteration.During by this algorithm application to blur image restoration, prerequisite is PSF must be known, or at least can estimate to obtain, and then by certain iterations, make output image converge to the close maximum likelihood image of same true picture, thus improve the display effect of blurred picture.
Richardson-Lucy algorithm hypothesis picture noise obeys Poisson distribution, and blurred picture g=h*f+ β, f and g represents original picture rich in detail and blurred picture respectively, and h represents PSF, and β represents picture noise, and " * " represents convolution algorithm.There is β=g-h*f after transposition, obtain the likelihood probability p (g|f) of image f identical with the probability distribution of the likelihood probability p (β) of noise, all obey Poisson distribution, when solving with maximal possibility estimation, conditional probability distribution:
p ( g | f ) = Π x , y ( ( f * h ) ( x , y ) ) g ( x , y ) e - ( f * h ) ( x , y ) g ( x , y ) ! - - - ( 7 )
In order to ask for maximal value, according to maximum Likelihood, after being taken the logarithm by above formula, two ends make it be zero to f (x, y) differentiate, then have:
∂ ln p ( g | f ) ( x , y ) ∂ f ( x , y ) = 0 - - - ( 8 )
[ g f * h * h * ] ( x , y ) = 1 - - - ( 9 )
Wherein h *for the adjoint matrix of h, i.e. h *(x, y)=h (-x ,-y).F (x, y) is multiplied by above formula two ends simultaneously, can obtain:
f ( x , y ) [ g f * h * h * ] ( x , y ) = f ( x , y ) - - - ( 10 )
Add iterative algorithm to solve it:
f α + 1 ( x , y ) = f α ( x , y ) [ g f α * h * h * ] ( x , y ) - - - ( 11 )
Wherein, α represents iterations.It is as follows that above formula transforms to frequency domain:
F α + 1 ( u , v ) = F α ( u , v ) [ G ( u , v ) F α ( u , v ) H ( u , v ) H * ( u , v ) ] - - - ( 12 )
Wherein (u, v) is frequency domain coordinates, F α(u, v) is the frequency domain value of the restored image after α-1 iteration, F α+1(u, v) is the frequency domain value of restored image after the α time iteration, the frequency domain value of the corresponding blurred picture g (x, y) of G (u, v), H (u, v) difference, PSFh (x, y), H *(u, v) is the conjugate matrices of H (u, v), and F 0(u, v)=G (u, v).
Here it is standard Richardson-Lucy algorithm, the method does not provide stopping criterion for iteration, and along with the increase of iterations α, restored image converges on original picture rich in detail gradually.This algorithm is when using small size PSF, and usually less iterations just can reach stable solution.As known PSF but picture noise information is unknown time, also can be undertaken there is efficient recovery by this restoration methods.
The feature utilizing Richardson-Lucy algorithm to carry out blur image restoration have following some:
(1) a given width original image, if PSF selects suitably, only to need less iterations, just can obtain good recovery effect;
(2) as long as the pixel non-negative of PSF and input picture, then the value of the pixel of the restored image obtained after iterative processing is also non-negative;
(3) if blurred picture and original image have larger deviation, as long as provide PSF accurately, can be restored with less iterations equally.
To obtain the PSF of mobile terminal shooting blurred picture in the method to step (4) according to the step (2) of restoring flow process after, first set iterations α by f in iterative equation 0(x, y) g (x is set to, y), initializes by first iteration is blurred picture self, then the PSF template that the step (4) h in formula (11) being set to recovery flow process is tried to achieve, finally carries out iteration according to formula (11) and obtains restored image.
Fig. 5 illustrates the effect contrast figure implementing said method, wherein Fig. 5 (a), (b) are two width blurred pictures, figure (c) is the recovery effect figure of figure (a), figure (d) is the lower right corner in the recovery effect figure of figure (b), figure (c), (d) is the PSF that this method is extracted.By Fig. 5 we can see use the present invention obtain the PSF of blurred picture after adopt Richardson-Lucy algorithm to carry out recovery can to obtain details restored image clearly, image definition is improved.
Those skilled in the art will readily understand; the foregoing is only preferred embodiment of the present invention; not in order to limit the present invention, all any amendments done within the spirit and principles in the present invention, equivalent replacement and improvement etc., all should be included within protection scope of the present invention.

Claims (2)

1. a shake Restoration method of blurred image for facing moving terminal, is characterized in that, comprise the steps:
(1) blurred picture during width mobile terminal shake is obtained;
(2) obtained in the camera shutter opening time by attitude sensor, shake the relevant output sequence of track to mobile terminal;
Wherein, output sequence is m × n group data, and data layout is (G x, G y, G z, t), m is the sample frequency of attitude sensor, and n is the shutter opening time of camera, G xrepresent the output valve of X-axis in the XYZ coordinate system of camera place, G yrepresent the output valve of Y-axis, G zrepresent the output valve of Z axis, t represents sampling instant, and wherein X-axis is the optical axis of camera, and Y-axis is the longitudinal axis of picture plane, and Z axis is the transverse axis of picture plane; Sampling instant t icorresponding output sequence is (G xi, G yi, G zi, t i), i is the sequence number of sampling instant, and the value of i is 1,2 ..., m × n;
(3) carry out processing the rotational angle obtaining mobile terminal to described output sequence, and described rotational angle is carried out virtual borderlines, obtain shake PSF template;
(4) according to described blurred picture and described shake PSF template, adopt Image Restoration Algorithm to carry out restoration disposal, obtain restored image.
2. shake Restoration method of blurred image as claimed in claim 1, it is characterized in that, obtain shake PSF template step and be specially:
(1) initialization empty chain table L, definition wherein each element is tlv triple (y, z, △ t), and makes the initial value of output sequence i be 1;
Y, z represent the position coordinates shaking the point on track in shake PSF template, and △ t represents the retention time of the attitude of mobile terminal at this point;
(2) camera t within the shutter opening time is obtained itime be engraved in the rotational angle θ of X-axis in XYZ coordinate system xi, the rotational angle θ of Y-axis yiwith the rotational angle θ of Z axis zi;
(3) by the rotational angle θ of camera Y-axis yiwith the rotational angle θ of Z axis zibe mapped in photo coordinate system, obtain t in picture plane ia location point (y of moment PSF i, z i, △ t i), and it is added in chained list L;
Wherein, y ifor t ithe deviation post of moment Y-axis, z ifor t ithe deviation post of moment Z axis, △ t ifor camera attitude is in the retention time of this position, y i=h × tan (θ yi), z i=h × tan (θ zi), △ t i=t i+1-t i, h is camera lens focal length;
(4) judge whether i equals m × n, if so, then enter step (5); If not, then i=i+1, and be back to step (2);
(5) y is obtained imaximum absolute value value and z imaximum absolute value value | z | m a x = MAX i = 1 m × n ( | z i | ) ;
(6) initialization one (2 × | y| max+ 1) OK, (2 × | z| max+ 1) the full 0 matrix M arranged, and make data sequence number j equal 1;
(7) the jth group data (y in chained list L is taken out j, z j, △ t j), by (y in matrix M j+ | y| max) row (z j+ | z| max) element value that arranges adds △ t j;
(8) judge whether j equals m × n, if so, then enter step (9); If not, then j adds 1, and is back to step (7);
(9) matrix M is normalized rear acquisition described shake PSF template.
CN201510459486.XA 2015-07-30 2015-07-30 A kind of shake Restoration method of blurred image of facing moving terminal Expired - Fee Related CN105069753B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201510459486.XA CN105069753B (en) 2015-07-30 2015-07-30 A kind of shake Restoration method of blurred image of facing moving terminal

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201510459486.XA CN105069753B (en) 2015-07-30 2015-07-30 A kind of shake Restoration method of blurred image of facing moving terminal

Publications (2)

Publication Number Publication Date
CN105069753A true CN105069753A (en) 2015-11-18
CN105069753B CN105069753B (en) 2018-06-26

Family

ID=54499111

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201510459486.XA Expired - Fee Related CN105069753B (en) 2015-07-30 2015-07-30 A kind of shake Restoration method of blurred image of facing moving terminal

Country Status (1)

Country Link
CN (1) CN105069753B (en)

Cited By (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106778730A (en) * 2016-12-29 2017-05-31 深圳爱拼信息科技有限公司 A kind of adaptive approach and system for quickly generating OCR training samples
CN107395961A (en) * 2017-07-07 2017-11-24 青岛海信移动通信技术股份有限公司 The restored method and device of a kind of view data
WO2018223381A1 (en) * 2017-06-09 2018-12-13 厦门美图之家科技有限公司 Video shake-prevention method and mobile device
CN109949234A (en) * 2019-02-25 2019-06-28 华中科技大学 Video restoration model training method and video restoration method based on depth network
CN111578839A (en) * 2020-05-25 2020-08-25 北京百度网讯科技有限公司 Obstacle coordinate processing method and device, electronic equipment and readable storage medium
CN113014823A (en) * 2021-03-25 2021-06-22 苏州科达科技股份有限公司 Anti-shake processing method, system, device and storage medium for image pickup apparatus
CN113049082A (en) * 2021-02-08 2021-06-29 杭州富加镓业科技有限公司 Detection method of seed crystal rod jitter detection device and crystal growth method
CN113139949A (en) * 2021-04-30 2021-07-20 逻腾(杭州)科技有限公司 Robot image ambiguity detection method
CN116300294A (en) * 2022-10-25 2023-06-23 荣耀终端有限公司 Method and device for simulating human body shake
WO2023185096A1 (en) * 2022-03-31 2023-10-05 荣耀终端有限公司 Image blurriness determination method and device related thereto

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101742050A (en) * 2009-12-03 2010-06-16 浙江大学 Method for restoring TDICCD image aiming at motion fuzzy core space shift variant
CN103947184A (en) * 2011-11-14 2014-07-23 三星电子株式会社 Photographing apparatus and image processing apparatus using coded light, and method thereof
US9049356B2 (en) * 2010-08-27 2015-06-02 Canon Kabushiki Kaisha Image processing method, image processing apparatus and image processing program

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101742050A (en) * 2009-12-03 2010-06-16 浙江大学 Method for restoring TDICCD image aiming at motion fuzzy core space shift variant
US9049356B2 (en) * 2010-08-27 2015-06-02 Canon Kabushiki Kaisha Image processing method, image processing apparatus and image processing program
CN103947184A (en) * 2011-11-14 2014-07-23 三星电子株式会社 Photographing apparatus and image processing apparatus using coded light, and method thereof

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
SHUAI JIA等: "Motion Blurred Image Restoration", 《2013 6TH INTERNATIONAL CONGRESS ON IMAGE AND SIGNAL PROCESSING》 *
徐沪萍等: "一种遥感图像振动模糊复原方法", 《华中科技大学学报(自然科学版)》 *

Cited By (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106778730B (en) * 2016-12-29 2020-07-07 深圳爱拼信息科技有限公司 Self-adaptive method and system for rapidly generating OCR training samples
CN106778730A (en) * 2016-12-29 2017-05-31 深圳爱拼信息科技有限公司 A kind of adaptive approach and system for quickly generating OCR training samples
CN110678898B (en) * 2017-06-09 2022-03-18 厦门美图之家科技有限公司 Video anti-shake method and mobile device
CN110678898A (en) * 2017-06-09 2020-01-10 厦门美图之家科技有限公司 Video anti-shake method and mobile device
WO2018223381A1 (en) * 2017-06-09 2018-12-13 厦门美图之家科技有限公司 Video shake-prevention method and mobile device
CN107395961A (en) * 2017-07-07 2017-11-24 青岛海信移动通信技术股份有限公司 The restored method and device of a kind of view data
CN109949234A (en) * 2019-02-25 2019-06-28 华中科技大学 Video restoration model training method and video restoration method based on depth network
CN109949234B (en) * 2019-02-25 2020-10-02 华中科技大学 Video restoration model training method and video restoration method based on deep network
CN111578839A (en) * 2020-05-25 2020-08-25 北京百度网讯科技有限公司 Obstacle coordinate processing method and device, electronic equipment and readable storage medium
CN113049082A (en) * 2021-02-08 2021-06-29 杭州富加镓业科技有限公司 Detection method of seed crystal rod jitter detection device and crystal growth method
CN113049082B (en) * 2021-02-08 2022-03-08 杭州富加镓业科技有限公司 Detection method of seed crystal rod jitter detection device and crystal growth method
CN113014823A (en) * 2021-03-25 2021-06-22 苏州科达科技股份有限公司 Anti-shake processing method, system, device and storage medium for image pickup apparatus
CN113139949A (en) * 2021-04-30 2021-07-20 逻腾(杭州)科技有限公司 Robot image ambiguity detection method
WO2023185096A1 (en) * 2022-03-31 2023-10-05 荣耀终端有限公司 Image blurriness determination method and device related thereto
CN116300294A (en) * 2022-10-25 2023-06-23 荣耀终端有限公司 Method and device for simulating human body shake
CN116300294B (en) * 2022-10-25 2024-04-12 荣耀终端有限公司 Method and device for simulating human body shake

Also Published As

Publication number Publication date
CN105069753B (en) 2018-06-26

Similar Documents

Publication Publication Date Title
CN105069753A (en) Mobile-terminal-oriented method for restoring blurred image caused by jitter
Su et al. Deep video deblurring for hand-held cameras
Hu et al. Joint depth estimation and camera shake removal from single blurry image
Shan et al. Rotational motion deblurring of a rigid object from a single image
US8428390B2 (en) Generating sharp images, panoramas, and videos from motion-blurred videos
Rengarajan et al. From bows to arrows: Rolling shutter rectification of urban scenes
Paramanand et al. Non-uniform motion deblurring for bilayer scenes
CN104103050B (en) A kind of real video restored method based on local policy
US9253415B2 (en) Simulating tracking shots from image sequences
Su et al. Spatially adaptive block-based super-resolution
CN104284059A (en) Apparatus and method for stabilizing image
Narayanan et al. A computationally efficient super-resolution algorithm for video processing using partition filters
Zhang et al. Intra-frame deblurring by leveraging inter-frame camera motion
KR101671391B1 (en) Method for deblurring video using modeling blurred video with layers, recording medium and device for performing the method
CN107610069A (en) DVS visualization video denoising methods based on shared K SVD dictionaries
Bareja et al. An effective iterative back projection based single image super resolution approach
Zhuang et al. Image stitching and rectification for hand-held cameras
Qin et al. Video superresolution reconstruction based on subpixel registration and iterative back projection
Zhang et al. Combining inertial measurements with blind image deblurring using distance transform
Schuon et al. Comparison of motion de-blur algorithms and real world deployment
CN102509281A (en) Double-image planar motion blur eliminating method based on transparency
Mathew et al. Self-attention dense depth estimation network for unrectified video sequences
CN111986121A (en) Based on Framellet l0Norm-constrained fuzzy image non-blind restoration method
Yap et al. A Nonlinear $ L _ {1} $-Norm Approach for Joint Image Registration and Super-Resolution
Gultekin et al. Multi‐frame motion deblurring of video using the natural oscillatory motion of dexterous legged robots

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20180626