CN102005036A - Method and device for automatically removing tripod afterimage in panoramic image - Google Patents
Method and device for automatically removing tripod afterimage in panoramic image Download PDFInfo
- Publication number
- CN102005036A CN102005036A CN 201010577716 CN201010577716A CN102005036A CN 102005036 A CN102005036 A CN 102005036A CN 201010577716 CN201010577716 CN 201010577716 CN 201010577716 A CN201010577716 A CN 201010577716A CN 102005036 A CN102005036 A CN 102005036A
- Authority
- CN
- China
- Prior art keywords
- border
- afterimage
- confidence
- module
- degree
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Abstract
The invention discloses a method and a device for automatically removing a tripod afterimage in a panoramic image, having the advantages of high recovery speed and good recovery effect. The invention has the technical scheme that the method comprises the following steps of: setting a to-be-replaced boundary on the original panoramic image so as to cover the tripod afterimage; setting a block in which boundary points taking the point on the to-be-replaced boundary as the center is located; finding out the point p' the block confidence of which is highest in all boundary points, wherein the block in which the boundary point corresponding to the point p' is located is psip'; expanding the to-be-replaced boundary to form an expanded boundary; finding out a block psiq' in which the boundary points are located within the range of the expanded boundary, which has the biggest compared feature similarity with the block psip' in which the boundary points of the point p' are located, wherein the boundary point corresponding to the psiq is q'; and replacing the psip' with the psiq'; assigning the 8 adjacent pixels of the point q' and the compared feature similarity maximum value of the point p' to the point p'; returning the step of finding out the point the confidence of which is highest; and finding out the point the confidence of which is highest in the block in which the unprocessed boundary points are located until all the to-be-replaced boundaries are processed.
Description
Technical field
The present invention relates to a kind of image processing method and device, relate in particular to the tripod afterimage that occurs in the panoramic picture is carried out the method and apparatus that robotization removes.
Background technology
When panoramic picture is taken, through regular meeting in panoramic picture inevitably appearance do not wish the tripod afterimage of preserving, this will bring very big loss to user's visual experience.Existing disposal route is to finish by manually removing, and concrete mode is in the local image that needs are removed, and by image editing tools, manually scratches the mode of figure, and tripod afterimage zone is repaired.The very big labor intensive of this mode of operation.Increased the burden of post-processed.
Traditional reparation image technique is divided into two classes.One class is based on image mending (inpainting) technology of several picture model, such technology is utilized partial differential equation and physics thermal diffusion principle, image is repaired, having of representative: M.Bertalmio, A.L.Bertozzi etc. " Navier-stokes, fluid dynamics, and image and video inpainting "; C.Ballester, V.Caselles etc. " Avariational model for filling-in gray level and color images "; T.F.Chanand J.Shen " Non-texture inpainting by curvature-driven diffusions (CDD) ".Such technology can be preserved the linear structure of image, but only is applicable to that the small scale of repairing in the image is damaged; Very bad for big slightly regional effect, usually occur significantly fuzzy at restoring area.Another kind of synthetic image completion (completion) technology of texture that is based on, wherein representational have: L.Liang, C.Liu etc. " Real-timetexture synthesis by patch-based sampling "; A.Efros and W.T.Freeman " Image quilting for texture synthesis and transfer "; M.Ashikhmin " Synthesizing natural textures "; Such technological merit is that speed is fast, but shortcoming can not well be preserved the image linear structure.Author afterwards improves this, such as " Object removal by exemplar-based inpainting " such as A.Criminisi in the thought of using for reference inpainting; D.Simakov etc. " Summarizing visual data using bidirectional similarity " .CHO, T.S. etc. " The patch transform and its appl ications to image editing "; KOMODAKIS, N. etc. " Image completion using efficient belief propagation viapriority scheduling and dynamic pruning "; KUMAR, " What is a goodnearest neighbors algorithm for finding similar patches in images such as N.? "; RUBINSTEIN, M. etc. " Improved seam carving for video retargeting "; WEXLER, Y etc. " Space-time completion of video ".This technology has effect preferably for the piece of losing big in the blank map picture, also can preserve the structure of image, but speed is very slow, and for the picture of a 1200*1200 size, repairing the 200*200 zone usually needs a few minutes even half an hour.Therefore above-mentioned technology is removed or is repaired and use for local image, all has significant limitation.
So, how in panoramic picture, to remove automatically or reparation tripod afterimage zone, be a urgent problem.
Summary of the invention
The objective of the invention is to address the above problem, a kind of method that removes tripod afterimage in the panoramic picture automatically is provided, have the advantage that reparation speed is fast and repairing effect is good.
Another object of the present invention is to provide a kind of device that removes tripod afterimage in the panoramic picture automatically.
Technical scheme of the present invention is: the present invention has disclosed a kind of method that removes tripod afterimage in the panoramic picture automatically, comprising:
Border to be replaced on the original panorama sketch is set, to hide the tripod afterimage;
Setting is with frontier point place piece that to wait to replace borderline point be the center;
Find out the highest some p ' of piece degree of confidence in all frontier points, the frontier point place piece of some p ' correspondence is ψ
P '
Border to be replaced is extended out, form and extend out the border, back;
In the scope that extends out the circle, back, find out and put the frontier point place piece ψ of p '
P 'Compare the frontier point place piece ψ of characteristic similarity maximum
Q ', ψ
Q 'Corresponding frontier point is q ', uses ψ
Q 'Replace ψ
P '
8 adjacent pixels of a q ' are composed to a p ' with the characteristic similarity maximal value of putting p ' comparison;
Return the step of searching the highest point of degree of confidence, in untreated frontier point place piece, search the highest point of degree of confidence, finish up to all boundary treatment to be replaced.
According to an embodiment who removes the method for tripod afterimage in the panoramic picture automatically of the present invention, in that being set, treating on the original graph also comprise before replacing the border:
Original panorama sketch is dwindled, so that follow-up process object is the original panorama sketch after dwindling.
According to an embodiment who removes the method for tripod afterimage in the panoramic picture automatically of the present invention, original panorama sketch is dwindled by interpolation algorithm.
According to an embodiment who removes the method for tripod afterimage in the panoramic picture automatically of the present invention, finding a p ' and some q ' afterwards, finding in the original panorama sketch corresponding two some p and q and this two some p and pairing ψ of q according to original panorama sketch scale down
pAnd ψ
q, use ψ
qReplace ψ
p, and 8 adjacent pixels that will put q are composed to a p with some p characteristic similarity maximal value relatively.
According to an embodiment who removes the method for tripod afterimage in the panoramic picture automatically of the present invention, treating on original panorama sketch is set replaced in the step on border, with waiting that replacing boundary marker is the color different with background colour, so that the border different with the background colour color becomes border to be replaced.
The present invention has also disclosed a kind of device that removes tripod afterimage in the panoramic picture automatically, comprising:
Boundary setting module is provided with the border to be replaced on the original panorama sketch, to hide the tripod afterimage;
Frontier point place piece is provided with module, couples boundary setting module, the frontier point place piece that to be provided with to wait replacing borderline point be the center;
The degree of confidence processing module couples the degree of confidence processing module, finds out the highest some p ' of piece degree of confidence in all frontier points, and the frontier point place piece of some p ' correspondence is ψ
P '
The border extends out module, couples the degree of confidence processing module, and border to be replaced is extended out, and forms to extend out the border, back;
Replacement processing module couples this border and extends out module, finds out and put the frontier point place piece ψ of p ' in the scope that extends out the circle, back
P 'Compare the frontier point place piece ψ of characteristic similarity maximum
Q ', ψ
Q 'Corresponding frontier point is q ', with frontier point place piece ψ
Q 'Replace frontier point place piece ψ
P '
The assignment module, couple replacement processing module and degree of confidence processing module, 8 adjacent pixels of a q ' are composed to a p ' with the characteristic similarity maximal value of putting p ' comparison, returning the degree of confidence processing module handles, in untreated frontier point place piece, search the highest point of degree of confidence by the degree of confidence processing module, finish up to all boundary treatment to be replaced.
According to an embodiment who removes the device of tripod afterimage in the panoramic picture automatically of the present invention, this device comprises that also image dwindles module, be coupled in before the boundary setting module, this image dwindles module original panorama sketch is dwindled, so that follow-up process object is the original panorama sketch after dwindling.
According to an embodiment who removes the device of tripod afterimage in the panoramic picture automatically of the present invention, dwindle to be provided with an interpolation process unit in the module at image, by the operation of the interpolation algorithm in the interpolation process unit original panorama sketch is dwindled.
According to an embodiment who removes the device of tripod afterimage in the panoramic picture automatically of the present invention, in replacement processing module, also comprise original panorama sketch map unit, this replacement processing module is finding a p ' and some q ' to start original panorama sketch map unit afterwards, and original panorama sketch map unit finds in the original panorama sketch corresponding two some p and q and this two some p and pairing ψ of q according to original panorama sketch scale down
pAnd ψ
q, so that ψ
qReplace ψ
p, and 8 adjacent pixels that will put q in the assignment module are composed to a p with some p characteristic similarity maximal value relatively.
According to an embodiment who removes the device of tripod afterimage in the panoramic picture automatically of the present invention, in boundary setting module, with waiting that replacing boundary marker is the color different with background colour, so that the border different with the background colour color becomes border to be replaced.
The present invention contrasts prior art following beneficial effect: the present invention can remove the tripod afterimage in the panoramic picture automatically, make the easier removal of supplier of full-view image because the inevitable tripod that occurs of panorama collection or other pan-shot equipment supporters remain in the problem in the full-view image, panoramic picture is handled tripod or the removal of other pan-shot equipment supporters too relies on manpower thereby solved, inefficiency, the problem that cost is too high.
Description of drawings
Fig. 1 is the process flow diagram of first embodiment of the method that removes tripod afterimage in the panoramic picture automatically of the present invention.
Fig. 2 is the process flow diagram of second embodiment of the method that removes tripod afterimage in the panoramic picture automatically of the present invention.
Fig. 3 is the refinement process flow diagram of Fig. 2 embodiment.
Fig. 4 is the schematic diagram of first embodiment of the device that removes tripod afterimage in the panoramic picture automatically of the present invention.
Fig. 5 is the schematic diagram of second embodiment of the device that removes tripod afterimage in the panoramic picture automatically of the present invention.
Embodiment
The invention will be further described below in conjunction with drawings and Examples.
Before introducing each embodiment of the present invention, at first panorama or panoramic picture (image) are done an explanation: if image is placed on a spherical space, or cubic space, or cylindrical space, or cone space, or in the ellipsoid space, by fixing in the above-mentioned space a bit as observation point, adopting the process of the image that this image of one-point perspective obtained to be panorama by this observation point plays, then this image is by the spherical panorama that is called of correspondence, or cube panorama, or cylindricality panorama, or taper panorama, or the ellipsoid panorama, and to be referred to as this image be panorama or panoramic picture (image).
Automatically remove first embodiment of the method for tripod afterimage in the panoramic picture
Fig. 1 shows the embodiment that removes the method for tripod afterimage in the panoramic picture automatically of the present invention.Seeing also Fig. 1, is the detailed description that removes each step of the method for tripod afterimage in the panoramic picture automatically to present embodiment below.
Step S10: the border to be replaced on the original panorama sketch is set, to hide selected image.
Border to be replaced can be labeled as unified color, covers in the background colour on the original panorama sketch.That is to say that will wait that replacing boundary marker is the color different with background colour, different with the background colour color like this borders just can be judged as border to be replaced.
Step S11: the frontier point place piece that to be provided with to wait replacing borderline point be the center.
Wait to replace borderline arbitrfary point around in certain pixel coverage, the piece that to be provided with this point be the center is used for carrying out follow-up contrast and replacement, the big I of piece is set arbitrarily.
Step S12: find out the highest some p ' of piece degree of confidence in all untreated frontier points, the frontier point place piece of this time point p ' correspondence is ψ
P '
Step S13: border to be replaced is extended out, form and extend out the border, back.
For example, border to be replaced originally is that (r * m), then extending out the border, back is (r+areasize) * (m+areasize), and wherein areasize is a parameter, be illustrated in bounds to be replaced and extend out big what pixels, will search in this scope can be for the piece image of replacing.
It should be noted that the mark of setting that is used for waits to replace unique pixel rgb value (color just) in the bounds with to extend out in circle, the back scope each pixel rgb value of former figure inequality entirely in step S10.
Step S14: in the scope that extends out the circle, back, find out the some p ' place piece ψ the highest with current degree of confidence
P 'Compare the frontier point place piece ψ of characteristic similarity maximum
Q ', ψ
Q 'Corresponding frontier point is q ', uses ψ
Q 'Replace ψ
P '
In this step, finished the image of some p ' place piece and replaced, but the pixel loss when preventing to replace at this moment need be carried out follow-up step, merge fully with on every side image guaranteeing to replace the image that obtains.
Step S15: 8 adjacent pixels that will put q ' are composed to a p ' with the characteristic similarity maximal value of putting p ' comparison.
This step jumps to step S11 after finishing, and replaces the whole inquiries in border until all waiting and finishes.
In this step, also need will be treated by a kind of technological means frontier point place piece (ψ for example
P ') get rid of outside round-robin seek scope next time, to guarantee when jumping to step S11, need not to search the border of having handled again.Such technological means for example is that the degree of confidence with a p ' is made as 0 (specifically can referring to the embodiment of Fig. 3).
In the present embodiment, between step S11 to S15, circulate, finish up to the boundary treatment to be replaced described in the step S10.
Automatically remove second embodiment of the method for tripod afterimage in the panoramic picture
Fig. 2 shows second embodiment that removes the method for tripod afterimage in the panoramic picture automatically of the present invention.Seeing also Fig. 2, is the detailed description to each step in the method for present embodiment below.
Step S20: original panorama sketch is dwindled, so that follow-up process object is the original panorama sketch after dwindling.
(n * n) is not if original panorama sketch itself just in this range of size, then needs to carry out convergent-divergent again, and with original panorama sketch substitution subsequent operation can to preset a range of size.
If original panorama sketch itself then adopts interpolation algorithm not in this range of size, it is zoomed in the range of size of n * n, and store the image that this dwindles separately.The purpose of minification is to improve the speed of computing, and when guaranteeing to search relevant matches point and zone, the traversal number of times that causes significantly reduces.
Step S21: judge the border to be replaced after original panorama sketch dwindles.
Border to be replaced can be labeled as unified color, covers in the background colour on the original graph.That is to say that will wait that replacing boundary marker is the color different with background colour, different with the background colour color like this borders just can be judged as border to be replaced.
Step S22: the frontier point place piece that to be provided with to wait replacing borderline point be the center.
Wait to replace borderline arbitrfary point around in certain pixel coverage, the piece that to be provided with this point be the center is used for carrying out follow-up contrast and replacement, the big I of piece is set arbitrarily.
Step S23: find out the highest some p ' of piece degree of confidence in all untreated frontier points, the frontier point place piece of this time point p ' correspondence is ψ
P '
Step S24: border to be replaced is extended out, form and extend out the border, back.
For example, border to be replaced originally is that (r * m), then extending out the border, back is (r+areasize) * (m+areasize), and wherein areasize is a parameter, be illustrated in bounds to be replaced and extend out big what pixels, will search in this scope can be for the piece image of replacing.
It should be noted that the mark that is used in step S21 waits to replace unique pixel rgb value (color just) in the bounds with to extend out in circle, the back scope each pixel rgb value of former figure inequality entirely.
Step S25: in the scope that extends out the circle, back, find out the some p ' place piece ψ the highest with current degree of confidence
P 'Compare the frontier point place piece ψ of characteristic similarity maximum
Q ', ψ
Q 'Corresponding frontier point is q ', finds corresponding in the original graph two some p and q and this two some p and pairing ψ of q according to the original graph scale down
pAnd ψ
q, use ψ
qReplace ψ
p
In this step, finished the image of some p place piece and replaced, but the pixel loss when preventing to replace at this moment need be carried out follow-up step, merge fully with on every side image guaranteeing to replace the image that obtains.
Step S26: the characteristic similarity maximal value that will put between 8 adjacent pixels of q and the some p is relatively composed to a p.
This step jumps to step S22 after finishing, and replaces the whole inquiries in border until all waiting and finishes.
In this step, also need will be treated by a kind of technological means frontier point place piece (ψ for example
P ') get rid of outside round-robin seek scope next time, to guarantee when jumping to step S22, need not to search the border of having handled again.Such technological means for example is that the degree of confidence with a p ' is made as 0 (specifically can referring to the embodiment of Fig. 3).
In the present embodiment, between step S22 to S26, circulate, finish up to the boundary treatment to be replaced described in the step S21.
Automatically remove the refinement of second embodiment of the method for tripod afterimage in the panoramic picture
Fig. 3 shows the further refinement flow process of above-mentioned Fig. 2 embodiment.Seeing also Fig. 3, below is the detailed description of each step in the refinement flow process of method of second embodiment.
Step S30: from original panorama sketch, choose the area to be repaired.
For example original panorama sketch is that (whether W * H), border to be repaired can be labeled as unified color, covers in background colour, be that the basis for estimation of waiting to replace the border is the color border different with other colors on it.
Step S31: judge that whether W and H are all greater than n.
N is a preset value, for example is 300 pixel values, and this is the value of an assurance operation efficiency that relatively is fit to.If W and H then carry out step S312, otherwise carry out step S314 all greater than the n pixel.
Step S312: the maximum ratio that obtains W and H and n is rate.
The formula that this step adopts be rate=max (W/n, H/n).
Step S314: with the rate assignment is 1.
Step S316: according to step S312 gained ratio, original panoramic picture is introduced interpolation algorithm, original graph is dwindled, minification is rate.
The interpolation algorithm that this step adopts can be bilinearity, thereby reduces the loss of pixel.
Step S32: adopt formula
Dwindle computing, obtain W ' and H '.
In this step, if according to step S314, then the rate value is 1, and W ' value equals W, and H ' value equals H.
Step S33: establish piece ψ
P 'Size is t*t, max ψ
P 'Be degree of confidence, max ψ
P 'Value is 0.
Piece ψ in this step
P 'For being the center with a p ', the length of side is the piece of t, and t is a natural number, and for example value is 10.
Step S34: whether judging point p ' is the area to be repaired of being demarcated among the step S30.
Whether the foundation of judging in this step is the pixel value of area to be repaired for the rgb value of point, and for example the pixel of the area to be repaired of setting in step S30 is green, and whether the rgb value that then is exactly judging point here is green.If green, then carry out step S342, if be not green, then carry out step S344.
Step S342: ask a p ' place piece ψ
P 'Degree of confidence.
Piece ψ
P 'The calculating of degree of confidence be a kind of known technology, for example:
P(p′)＝C(p′)D(p′)
Here | ψ
P '| be ψ
P 'Area.α is the image normalization factor, is defaulted as 255 here.Ω is the area to be repaired, n
P 'For being orthogonal to the vector of unit length of p ' tangential direction.
Isophote for p '.
The confidence value of C (u) expression point u, u represents certain pixel.
The P that wherein obtains (p ') is a p ' place piece ψ
P 'Degree of confidence.
Step S344: in the image that dwindles (being of a size of W ' * H '), seek next pixel.
If there is next pixel, then carries out step S345, otherwise carry out step S348 in this step.
Step S345: in the image that dwindles (being of a size of W ' * H '), p ' is made as next pixel.
After this step is finished, carry out step S34.
Step S346: the ψ that will in step S342, be obtained
P 'Degree of confidence and max ψ
P 'Degree of confidence compare.
In this step, if ψ
P 'Degree of confidence greater than max ψ
P 'Degree of confidence then carry out step S347, if ψ
P 'Degree of confidence be less than or equal to max ψ
P 'Degree of confidence then carry out step S35.
Step S348: finish removing of selected image, this method finishes.
Step S347: with ψ
P 'The degree of confidence assignment give max ψ
P 'Degree of confidence, carry out step S35 then.
In this step simultaneously with savepoint p ', in order to bring the computing that step S37 is carried out into.
Step S35:, then carry out step S36, otherwise get back to step S345 to search next pixel if pixel is last pixel of searching in the image (being of a size of W ' * H ') that dwindles.
Step S36: outside the most external rectangle of current boundary curve (r*m), extend out areasize pixel again, delimit flared region, be of a size of (r+areasize) * (m+areasize).
Boundary rectangle in this step (r*m) is the formed rectangle in outer (r*m) of the described area to be repaired of S30.
The value of areasize for example is made as 35 in this step, and this numerical value can improve the operation efficiency of subsequent step when bringing computing into.
Step S37: the q ' that sets up an office (is of a size of the point in the zone except that the described area to be repaired of step S30 among (r+areasize) * (m+areasize) for the described flared region of step S36.If piece ψ
Q 'For being the piece zone at center with a q ', piece ψ
Q 'Size be t*t, establish min ψ
Q 'The Euclidean distance quadratic sum be infinitely great.
In this step, piece ψ
Q 'The value of length of side t for example be made as 10, with piece ψ
P 'The length of side identical.Be convenient to piece ψ in the subsequent step
Q 'To piece ψ
P 'Pixel replacement.
Step S38: judge in flared region, whether to also have piece ψ
Q ', then carry out step S382 if exist, then do not carry out step S384 if do not exist.
Step S382: the Euclidean distance quadratic sum of judging point q ' and some p '
With min ψ
Q 'The size of Euclidean distance quadratic sum, if the Euclidean distance quadratic sum of some q ' and some p '
Less than min ψ
Q 'The Euclidean distance quadratic sum, then carry out step S386, otherwise carry out step S384, wherein I
Q ' rgbThe pixel value of expression q ' some RGB, I
P ' rgbThe pixel value of expression p ' some RGB.
Step S386: will
Assignment is to min ψ
Q 'The Euclidean distance quadratic sum.
Also will keep q ' point in this step, this is named a person for a particular job and brings subsequent step S387 or S388 into.
After this step is finished, the judgement of step S38 will be proceeded.
Step S384:, otherwise carry out step S388 if the rate value equals 1 and carries out step S387.
The rate value of rate value described in this step for obtaining among step S312 or the step S314.
Step S387: will put q ' place piece ψ
Q 'Pixel copy the piece ψ at p ' place to
P 'In.
This step will make a p ' place piece ψ
P 'Pixel be replaced, finish in this piece removing of selected image.
After finishing, this step will carry out subsequent step S392.
Step S388: in original graph (being of a size of W*H), find a little and point.This step is that the mapping relations employing formula of a linearity is p=rate*p ' and q=rate*q '.
The rate value of rate value described in this step for obtaining among step S312 or the step S314.
After finishing, this step will carry out step S389.
Step S389: will put q place piece ψ
qPixel copy the piece ψ at a p place to
pIn.
This step will make a p place piece ψ
pPixel be replaced, finish in this piece removing of selected image.
After finishing, this step will carry out step S394.
Step S392: will put 8 adjacent pixels of q ' and European square of minimum value of p ' some comparison and compose to a p '.
After finishing, this step will proceed step S39.
Step S394: 8 adjacent pixels and the p point European square of minimum value relatively that will put q are composed to a p.
After finishing, this step will proceed step S39.
Step S39: the degree of confidence that will put p ' is made as 0.
This step makes judges the value that obtains among the subsequent step S346 always for not, thereby is carried out follow-up step S35.
After finishing, this step will carry out step S344.
Automatically remove first embodiment of the device of tripod afterimage in the panoramic picture
Fig. 4 shows the principle of first embodiment of the device that removes tripod afterimage in the panoramic picture automatically of the present invention.Seeing also Fig. 4, is the detailed description to the principle of the device of present embodiment below.
Automatically the device that removes tripod afterimage in the panoramic picture of present embodiment comprises following module: boundary setting module 10, frontier point place piece are provided with module 11, degree of confidence processing module 12, border and extend out module 13, replacement processing module 14 and assignment module 15.Annexation between these modules is: boundary setting module 10 couples frontier point place piece module 11 is set, frontier point place piece is provided with module 11 and couples degree of confidence processing module 12, degree of confidence processing module 12 couples the border and extends out module 13, the border extends out module 13 and couples replacement processing module 14, replacement processing module 14 couples assignment module 15, and the assignment module also couples degree of confidence processing module 12 except coupling replacement processing module 14.
Frontier point place piece is provided with module 11 and is used to be provided with to wait replacing borderline some the frontier point place piece that is the center.Wait to replace borderline arbitrfary point around in certain pixel coverage, the piece that to be provided with this point be the center is used for carrying out follow-up contrast and replacement, the big I of piece is set arbitrarily.
In the degree of confidence processing module 12, find out the highest some p ' of piece degree of confidence in all untreated frontier points, the frontier point place piece of this time point p ' correspondence is ψ
P 'The calculating of piece degree of confidence is traditional technological means, and has a detailed description in the refinement of method second embodiment.
The border extends out module 13 border to be replaced is extended out, and forms to extend out the border, back.For example, border to be replaced originally is that (r * m), then extending out the border, back is (r+areasize) * (m+areasize), and wherein areasize is a parameter, be illustrated in bounds to be replaced and extend out big what pixels, will search in this scope can be for the piece image of replacing.
It should be noted that in boundary setting module 10 mark of setting that is used for waits to replace unique pixel rgb value (color just) in the bounds with to extend out in circle, the back scope each pixel rgb value of former figure inequality entirely.
In the replacement processing module 14, find out the some p ' place piece ψ the highest in the scope on border after extending out with current degree of confidence
P 'Compare the frontier point place piece ψ of characteristic similarity maximum
Q ', ψ
Q 'Corresponding frontier point is q ', uses ψ
Q 'Replace ψ
P '
In this module, finished the image of some p ' place piece and replaced, but the pixel loss when preventing to replace at this moment need be carried out the processing of subsequent module, merge fully with on every side image guaranteeing to replace the image that obtains.
After assignment module 15 is handled, jump to degree of confidence processing module 12, in untreated frontier point place piece, search the highest point of degree of confidence by degree of confidence processing module 12, replace the whole inquiries in border until all waiting and finish.
In degree of confidence processing module 12, need by the treated frontier point place piece of a kind of technological means general (ψ for example
P ') get rid of outside round-robin seek scope next time, to guarantee the searching border of having handled again.Such technological means for example is that the degree of confidence with a p ' is made as 0 (specifically can referring to the embodiment of Fig. 3).
Automatically remove second embodiment of the device of tripod afterimage in the panoramic picture
Fig. 5 shows the principle of second embodiment of the device that removes tripod afterimage in the panoramic picture automatically of the present invention.Seeing also Fig. 5, is the detailed description to the principle of the device of present embodiment below.
Automatically the device that removes tripod afterimage in the panoramic picture of present embodiment comprises following module: image dwindles module 20, boundary setting module 21, frontier point place piece and module 22, degree of confidence processing module 23, border are set extend out module 24, replacement processing module 25 and assignment module 26.Annexation between these modules is: image dwindles module 20 and couples boundary setting module 21, boundary setting module 21 couples frontier point place piece module 22 is set, frontier point place piece is provided with module 22 and couples degree of confidence processing module 23, degree of confidence processing module 23 couples the border and extends out module 24, the border extends out module 24 and couples replacement processing module 25, replacement processing module 25 couples assignment module 26, and assignment module 26 also couples degree of confidence processing module 23 except coupling replacement processing module 25.In image dwindles module 20, be provided with interpolation process unit 200, in replacement processing module 25, be provided with original panorama sketch map unit 250.
Dwindle in the module 20 at image, (n * n) is not if original panorama sketch itself just in this range of size, then needs to carry out convergent-divergent again, and with original graph substitution subsequent operation can to preset a range of size.
If original panorama sketch itself then moves interpolation process unit 200 not in this range of size, interpolation process unit 200 adopts interpolation algorithm, original graph is zoomed in the range of size of n * n, and stores the image that this dwindles separately.The purpose of minification is to improve the speed of computing, and when guaranteeing to search relevant matches point and zone, the traversal number of times that causes significantly reduces.
Frontier point place piece is provided with module 22 and is used to be provided with to wait replacing borderline some the frontier point place piece that is the center.Wait to replace borderline arbitrfary point around in certain pixel coverage, the piece that to be provided with this point be the center is used for carrying out follow-up contrast and replacement, the big I of piece is set arbitrarily.
In the degree of confidence processing module 23, find out the highest some p ' of piece degree of confidence in all untreated frontier points, the frontier point place piece of this time point p ' correspondence is ψ
P 'The calculating of piece degree of confidence is traditional technological means, and has a detailed description in the refinement of method second embodiment.
The border extends out module 24 border to be replaced is extended out, and forms to extend out the border, back.For example, border to be replaced originally is that (r * m), then extending out the border, back is (r+areasize) * (m+areasize), and wherein areasize is a parameter, be illustrated in bounds to be replaced and extend out big what pixels, will search in this scope can be for the piece image of replacing.
It should be noted that in boundary setting module 21 mark of setting that is used for waits to replace unique pixel rgb value (color just) in the bounds with to extend out in circle, the back scope each pixel rgb value of former figure inequality entirely.
In the replacement processing module 25, find out the some p ' place piece ψ the highest in the scope on border after extending out with current degree of confidence
P 'Compare the frontier point place piece ψ of characteristic similarity maximum
Q ', ψ
Q 'Corresponding frontier point is q '.
Find some p ' and some q ' afterwards, finding in the original graph piece ψ of corresponding two some p and q and these two some correspondences by original panorama sketch map unit 250 according to the original graph scale down
pAnd ψ
qUse ψ
qReplace ψ
p
In this module, finished the image of some p place piece and replaced, but the pixel loss when preventing to replace at this moment need be carried out the processing of subsequent module, merge fully with on every side image guaranteeing to replace the image that obtains.
After assignment module 26 is handled, jump to degree of confidence processing module 23, in untreated frontier point place piece, search the highest point of degree of confidence by degree of confidence processing module 23, replace the whole inquiries in border until all waiting and finish.
In degree of confidence processing module 23, need by the treated frontier point place piece of a kind of technological means general (ψ for example
p) get rid of outside round-robin seek scope next time, to guarantee the searching border of having handled again.Such technological means for example is that the piece degree of confidence with a p is made as 0 (specifically can referring to the embodiment of Fig. 3).
The foregoing description provides to those of ordinary skills and realizes or use of the present invention; those of ordinary skills can be under the situation that does not break away from invention thought of the present invention; the foregoing description is made various modifications or variation; thereby protection scope of the present invention do not limit by the foregoing description, and should be the maximum magnitude that meets the inventive features that claims mention.
Claims (10)
1. method that removes tripod afterimage in the panoramic picture automatically comprises:
Border to be replaced on the original panorama sketch is set, to hide the tripod afterimage;
Setting is with frontier point place piece that to wait to replace borderline point be the center;
Find out the highest some p ' of piece degree of confidence in all frontier points, the frontier point place piece of some p ' correspondence is ψ
P '
Border to be replaced is extended out, form and extend out the border, back;
In the scope that extends out the circle, back, find out and put the frontier point place piece ψ of p '
P 'Compare the frontier point place piece ψ of characteristic similarity maximum
Q ', ψ
Q 'Corresponding frontier point is q ', uses ψ
Q 'Replace ψ
P '
8 adjacent pixels of a q ' are composed to a p ' with the characteristic similarity maximal value of putting p ' comparison;
Return the step of searching the highest point of degree of confidence, in untreated frontier point place piece, search the highest point of degree of confidence, finish up to all boundary treatment to be replaced.
2. the method that removes tripod afterimage in the panoramic picture automatically according to claim 1 is characterized in that, also comprises before replacing the border in that treating on the original graph is set:
Original panorama sketch is dwindled, so that follow-up process object is the original panorama sketch after dwindling.
3. the method that removes tripod afterimage in the panoramic picture automatically according to claim 2 is characterized in that, by interpolation algorithm original panorama sketch is dwindled.
4. the method that removes tripod afterimage in the panoramic picture automatically according to claim 2, it is characterized in that, finding a p ' and some q ' afterwards, finding in the original panorama sketch corresponding two some p and q and this two some p and pairing ψ of q according to original panorama sketch scale down
pAnd ψ
q, use ψ
qReplace ψ
p, and 8 adjacent pixels that will put q are composed to a p with some p characteristic similarity maximal value relatively.
5. the method that removes tripod afterimage in the panoramic picture automatically according to claim 1, it is characterized in that, treating on original panorama sketch is set replaced in the step on border, with waiting that replacing boundary marker is the color different with background colour, so that the border different with the background colour color becomes border to be replaced.
6. device that removes tripod afterimage in the panoramic picture automatically comprises:
Boundary setting module is provided with the border to be replaced on the original panorama sketch, to hide the tripod afterimage;
Frontier point place piece is provided with module, couples boundary setting module, the frontier point place piece that to be provided with to wait replacing borderline point be the center;
The degree of confidence processing module couples the degree of confidence processing module, finds out the highest some p ' of piece degree of confidence in all frontier points, and the frontier point place piece of some p ' correspondence is ψ
P '
The border extends out module, couples the degree of confidence processing module, and border to be replaced is extended out, and forms to extend out the border, back;
Replacement processing module couples this border and extends out module, finds out and put the frontier point place piece ψ of p ' in the scope that extends out the circle, back
P 'Compare the frontier point place piece ψ of characteristic similarity maximum
Q ', ψ
Q 'Corresponding frontier point is q ', with frontier point place piece ψ
Q 'Replace frontier point place piece ψ
P '
The assignment module, couple replacement processing module and degree of confidence processing module, 8 adjacent pixels of a q ' are composed to a p ' with the characteristic similarity maximal value of putting p ' comparison, returning the degree of confidence processing module handles, in untreated frontier point place piece, search the highest point of degree of confidence by the degree of confidence processing module, finish up to all boundary treatment to be replaced.
7. the device that removes tripod afterimage in the panoramic picture automatically according to claim 6, it is characterized in that, this device comprises that also image dwindles module, be coupled in before the boundary setting module, this image dwindles module original panorama sketch is dwindled, so that follow-up process object is the original panorama sketch after dwindling.
8. the device that removes tripod afterimage in the panoramic picture automatically according to claim 7, it is characterized in that, dwindle to be provided with an interpolation process unit in the module at image, original panorama sketch is dwindled by the operation of the interpolation algorithm in the interpolation process unit.
9. the device that removes tripod afterimage in the panoramic picture automatically according to claim 7, it is characterized in that, in replacement processing module, also comprise original panorama sketch map unit, this replacement processing module is finding a p ' and some q ' to start original panorama sketch map unit afterwards, and original panorama sketch map unit finds in the original panorama sketch corresponding two some p and q and this two some p and pairing ψ of q according to original panorama sketch scale down
pAnd ψ
q, so that ψ
qReplace ψ
p, and 8 adjacent pixels that will put q in the assignment module are composed to a p with some p characteristic similarity maximal value relatively.
10. the device that removes tripod afterimage in the panoramic picture automatically according to claim 6, it is characterized in that, in boundary setting module, with waiting that replacing boundary marker is the color different with background colour, so that the border different with the background colour color becomes border to be replaced.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201010577716XA CN102005036B (en) | 2010-12-08 | 2010-12-08 | Method and device for automatically removing tripod afterimage in panoramic image |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201010577716XA CN102005036B (en) | 2010-12-08 | 2010-12-08 | Method and device for automatically removing tripod afterimage in panoramic image |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN102005036A true CN102005036A (en) | 2011-04-06 |
| CN102005036B CN102005036B (en) | 2012-05-09 |
Family
ID=43812376
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201010577716XA Expired - Fee Related CN102005036B (en) | 2010-12-08 | 2010-12-08 | Method and device for automatically removing tripod afterimage in panoramic image |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN102005036B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2012075729A1 (en) * | 2010-12-08 | 2012-06-14 | 上海杰图软件技术有限公司 | Method and device for removing selected image in picture automatically |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2007020930A1 (en) * | 2005-08-15 | 2007-02-22 | Sony Corporation | Imaging device, noise reduction device, noise reduction method, and program |
| CN101355648A (en) * | 2008-06-26 | 2009-01-28 | 天津市亚安科技电子有限公司 | Method for reducing image noise and enhancing image |
| CN101360246A (en) * | 2008-09-09 | 2009-02-04 | 西南交通大学 | Video error masking method combined with 3D human face model |
| CN101571950A (en) * | 2009-03-25 | 2009-11-04 | 湖南大学 | Image restoring method based on isotropic diffusion and sparse representation |
| CN101729742A (en) * | 2008-10-24 | 2010-06-09 | 佳能株式会社 | Image forming apparatus and control method thereof |
-
2010
- 2010-12-08 CN CN201010577716XA patent/CN102005036B/en not_active Expired - Fee Related
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2007020930A1 (en) * | 2005-08-15 | 2007-02-22 | Sony Corporation | Imaging device, noise reduction device, noise reduction method, and program |
| CN101355648A (en) * | 2008-06-26 | 2009-01-28 | 天津市亚安科技电子有限公司 | Method for reducing image noise and enhancing image |
| CN101360246A (en) * | 2008-09-09 | 2009-02-04 | 西南交通大学 | Video error masking method combined with 3D human face model |
| CN101729742A (en) * | 2008-10-24 | 2010-06-09 | 佳能株式会社 | Image forming apparatus and control method thereof |
| CN101571950A (en) * | 2009-03-25 | 2009-11-04 | 湖南大学 | Image restoring method based on isotropic diffusion and sparse representation |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2012075729A1 (en) * | 2010-12-08 | 2012-06-14 | 上海杰图软件技术有限公司 | Method and device for removing selected image in picture automatically |
Also Published As
| Publication number | Publication date |
|---|---|
| CN102005036B (en) | 2012-05-09 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107507134B (en) | Super-resolution method based on convolutional neural network | |
| CN104376535B (en) | A kind of rapid image restorative procedure based on sample | |
| Wang et al. | Robust object removal with an exemplar-based image inpainting approach | |
| CN108184115B (en) | HEVC intra-frame CU partition and PU prediction mode selection method and system | |
| CN111881720B (en) | Automatic enhancement and expansion method, recognition method and system for data for deep learning | |
| CN103971338B (en) | Variable-block image repair method based on saliency map | |
| CN105741231B (en) | The skin makeup treating method and apparatus of image | |
| CN107330885B (en) | Multi-operator image redirection method for keeping aspect ratio of important content area | |
| CN103578085B (en) | Image cavity region based on variable-block method for repairing and mending | |
| Kim et al. | Example-based super-resolution via structure analysis of patches | |
| CN106447607B (en) | A kind of image split-joint method and device | |
| CN104200444A (en) | Image restoring method based on symmetric sample pieces | |
| CN109767408A (en) | Image processing method, device, storage medium and computer equipment | |
| CN105354810A (en) | Method, system and shooting terminal for removing speckles of image | |
| CN102005060B (en) | Method and device for automatically removing selected images in pictures | |
| CN103942756A (en) | Post-processing filtering method for depth map | |
| CN103685858A (en) | Real-time video processing method and equipment | |
| CN102005036B (en) | Method and device for automatically removing tripod afterimage in panoramic image | |
| CN105139345A (en) | Automatic searching method of high-quality non-standard Gamma curve | |
| CN104112260A (en) | Look-up table-based inverse halftone method | |
| Arora et al. | Augmentation of Images through DCGANs | |
| CN106296605B (en) | A kind of image mending method and device | |
| Chavda et al. | Survey on image inpainting techniques: Texture synthesis, convolution and exemplar based algorithms | |
| CN114820340A (en) | Lip wrinkle removing method, system, equipment and storage medium based on image processing | |
| CN111080512B (en) | Cartoon image generation method and device, electronic equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| EE01 | Entry into force of recordation of patent licensing contract |
Application publication date: 20110406 Assignee: BEIJING BAIDU NETCOM SCIENCE AND TECHNOLOGY Co.,Ltd. Assignor: SHANGHAI JEITU SOFTWARE Co.,Ltd. Contract record no.: 2014310000050 Denomination of invention: Method and device for automatically removing tripod afterimage in panoramic image Granted publication date: 20120509 License type: Common License Record date: 20140321 |
|
| LICC | Enforcement, change and cancellation of record of contracts on the licence for exploitation of a patent or utility model | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20120509 Termination date: 20211208 |
|
| CF01 | Termination of patent right due to non-payment of annual fee |