CN101079151A - 360 degree around panorama generation method based on serial static image - Google Patents

360 degree around panorama generation method based on serial static image Download PDF

Info

Publication number
CN101079151A
CN101079151A CN 200610053842 CN200610053842A CN101079151A CN 101079151 A CN101079151 A CN 101079151A CN 200610053842 CN200610053842 CN 200610053842 CN 200610053842 A CN200610053842 A CN 200610053842A CN 101079151 A CN101079151 A CN 101079151A
Authority
CN
China
Prior art keywords
image
pixel
value
generation method
template
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN 200610053842
Other languages
Chinese (zh)
Other versions
CN100485720C (en
Inventor
朱信忠
赵建民
徐慧英
杨琳
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Zhejiang Normal University CJNU
Original Assignee
Zhejiang Normal University CJNU
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Zhejiang Normal University CJNU filed Critical Zhejiang Normal University CJNU
Priority to CNB2006100538429A priority Critical patent/CN100485720C/en
Publication of CN101079151A publication Critical patent/CN101079151A/en
Application granted granted Critical
Publication of CN100485720C publication Critical patent/CN100485720C/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Abstract

The invention discloses a full view generating method of a sequence static picture for splicing a group of static pictures to a cylindrical full view picture. A group of static pictures are twelve or more than twelve pictures that the digital camera takes the object or the environment of the needed generating full view picture from the different angle. The method comprises the following steps: taking the sequence pictures; preprocessing the taken pictures; splicing the pictures. The method needs the low hardware device and doesn' t need the expensive hardware investment, which provides the quick resultant velocity, the high intellectual degree, and can display the full view pictures.

Description

A kind of based on serial static image 360 ° are looked around panorama generation method
Technical field
The present invention relates to 360 ° of generation methods of looking around panoramic picture.
Background technology
Panorama sketch is a kind of important scene method for expressing in virtual reality and the computation vision, and it refers in fixing viewpoint, and at the image views of 360 ° of 180 ° of vertical direction and horizontal directions, simple form can be that fixedly 360 ° on the view plane are looked around view.Usually there is dual mode to obtain panorama sketch: direct mode and image mosaic mode.Preceding a kind of mode is simple, but it need use special equipment such as professional panorama camera, panoramic camera, and these equipment cost an arm and a leg usually and use complexity, and practical application face is narrower, is difficult to popularize.Therefore the application based on the aphorama drawing generating method of image mosaic thought is very extensive.Image mosaic utilizes some discrete topographies as basic data exactly, generates panorama through after a series of image analysis processing.
Panorama sketch generally has three kinds of forms: cube panorama sketch, spherical panorama figure and cylindrical panoramic figure.The cube panorama sketch image obtain with trimming process in can run into very big difficulty.Image in the spherical panorama figure splicing is asked difficulty of friendship, location, and is difficult to find a kind of data structure corresponding with sphere, that be easy to the Computer Storage visit to deposit the sphere view data.Cylindrical panoramic figure obtains simpler than cubic form and sphere form at single image, and expands into a rectangular image easily, can be directly with computing machine picture format storage and visit commonly used.
As number of patent application is 200410015828.0 Chinese invention patent application, discloses a kind of 180 ° big visual field panorama staring imaging methods.It adopts cylinder plane projection method, lens ring with secondary reflection is done imaging for the first time, realize panorama staring imaging with great visual angle, do imaging for the second time with relay lens, obtain real image, meet receipts And with plane photoelectricity image device and show three dimensions, be mainly used in fields such as robot panoramic vision, inner-walls of duct detection, medical science based endoscopic imaging, though proposed a kind of scheme of directly obtaining panoramic picture, but the generation method of panoramic picture is higher to hardware condition and environmental requirement in this scheme, and can not generate complete 360 ° and look around panorama.
As application number is 03115149.3 Chinese invention patent, discloses a kind of panorama generation method based on two fish eye images.This method comprises the fish eye images pre-service, sets up spatial model, the hybrid parameter optimizing, generate four parts of panoramic picture.But can not find the best hybrid parameter of model in actual applications automatically, fast, need the artificial hybrid parameter of adjusting.Especially crucial is, because the present invention requires to treat that the fish eye images of amalgamation must possess complete in theory spatial model, can only adopt two fish eye images, needs camera to assemble expensive fish eye lens, the common plane image can not use, and is difficult to obtain popular popularization and application.
Application number is 03137660.6 Chinese invention patent for another example, disclose a kind of plane picture panorama and rebuild the method for stereo-picture, its process comprises, select plane picture, at the space distribution of plane picture, set up the degree of depth tabulation of each pixel, according to degree of depth tabulation each pixel of plane picture is carried out parallaxial displacement and handle, rebuild whole parallax sequence images, the parallax sequence image is three-dimensional synthetic.Wherein, adopted three-dimensional modeling, image geometry conversion, image parallactic converter technique to realize the reconstruction of stereo-picture.But this method plane picture obtain, handle and location, trimming process in can run into a lot of practical difficulties, and be difficult to handle the big figure of outdoor scene and realize controlled stereoscopic depth.
In addition, application number is 200510087641.6 Chinese invention patent, discloses a kind of digital imaging apparatus and method thereof that is used to create panoramic picture, and wherein, digital imaging apparatus comprises the part of catching that is used for catching continuously a plurality of images; Be used for detecting respectively image information test section from a plurality of images of catching part output; The panoramic picture generating portion that is used for image transitions.By selecting a group from a plurality of image informations of image information test section output, by selected image information is merged conversion, thereby create panoramic picture.But this method actual treatment speed is slower, and can only be used for special-purpose panorama digital imaging apparatus.
The shortcoming that existing panorama image generation method exists is: 1, if adopt the method that directly generates panoramic picture, then hardware device is had relatively high expectations, cost an arm and a leg, be difficult to popularization and application; 2, the existing method that generates panoramic picture by image amalgamation technology, need special-purpose fish eye lens equipment, realize that difficulty, intelligent degree are low, can't use image request height, location and correction difficulty, general camera photo, processing speed waits more slowly, even final synthetic panorama sketch effect is also relatively poor.
Summary of the invention
In order to overcome the shortcoming and defect that existing panorama image generation method exists, the invention provides a kind of (only needing ordinary digital camera or common plane photo) low for equipment requirements, practical cheap, realize easy, intelligent degree height, processing speed is fast, panorama sketch is clear, strong sense of reality, applicability are wide, be easy to popularize look around panorama generation method based on 360 ° of serial static image.
The technical solution adopted for the present invention to solve the technical problems is:
A kind of based on serial static image 360 ° are looked around panorama generation method, and this method comprises the steps:
(1) takes required sequence image with camera;
(2) sequence image is carried out pre-service: adopt medium filtering to carry out denoising, histogram equalization is handled;
(3) splicing of sequence image: by with being spliced to form 360 ° and looking around panoramic picture of adjacent front and back image, may further comprise the steps:
(3.1) picture shot is projected to 360 ° of horizontal cylinders by conversion;
(3.2) in the preceding piece image of two width of cloth adjacent images that read in, select all suitable image in a block size and position as template, determine the hunting zone in the piece image of back, obtain the best match position l of adjacent two width of cloth images i, obtain in the sequence image best match position of every adjacent two width of cloth images successively;
(3.3), each pixel of its correspondence is synthesized to new image by certain weights at the overlapping region S and the T of two width of cloth adjacent images.The weights computing formula of each pixel on each image is as follows:
W Value = cos ( π 2 * | x - x 0 2 x 0 2 | ) * cos ( π 2 * | y - y 0 2 y 0 2 | ) - - - ( 1 )
W in the formula ValueThe expression weights, (x 0, y 0) be the center of intersection, (x y) is pixel coordinates; The overlapping region S of adjacent image and each pixel value of T correspondence are synthesized new image by certain weight; The pixel value of intersection can be expressed as:
I N′=I N×W Value1+I N+1×W Value2 (2)
Wherein, I NAnd I N+1The pixel value of pixel in original image separately of representing certain corresponding lap position of two adjacent images respectively, W Value1And W Value2The weights that are this pixels of calculating according to formula (1) on image separately, its span is (0,1), and and is 1.
As preferred a kind of scheme: in described (2), adopt histogram equalization to handle transforming function transformation function:
s k = T ( r k ) = Σ i = 0 k n i n , k = 0,1,2 · · · , L - 1 - - - ( 3 )
Wherein, n is the sum total of pixel in the image, n kBe that gray level is r kThe pixel number, L is a number of greyscale levels possible in the image, general value is 256;
Is r by formula (3) with gray level in the input picture kPixel to be mapped as the output image gray level be s kCorresponding pixel.
As preferred another kind of scheme: in described (3.1), 360 ° of horizontal cylinder projective transformation formula are:
Wherein,
Figure A20061005384200102
k = r 2 + ( W 2 - x ) 2 , (x, y) be on the input picture more arbitrarily, (x 1, y 1) be the coordinate figure of this o'clock after through 360 ° of horizontal cylinder projective transformations, θ is a projection angle, and W is the width of image, and H is the height of image.
As preferred another scheme: in described (3.2), the absolute error function of definition image is:
ϵ ( i , j , m k , n k ) = | s i , j ( m k , n k ) - s ^ ( i , j ) - T ( m , n ) + T ^ | - - - ( 5 )
Wherein, s ^ ( i , j ) = 1 M 2 Σ m = 1 M Σ n = 1 M s i , j ( m , n ) , T ^ = 1 M 2 Σ m = 1 M Σ n = 1 M T ( m , n ) , T is a template, and S is searched figure, s I, jBe subgraph, that block search figure under promptly template covers, i, j are the coordinate of subgraph top left pixel point in S, M is the wide and high of template.
With the horizontal range of the vertical center line of template center and place image, note is made x 1Afterwards, all picture elements in the subimage of traversal template image and first position calculate ε (i, j, the m of corresponding picture element k, n k) and add up after with its initial value T as threshold value 0
ε (i, j, the m of corresponding picture element in calculation template image and the next position subimage again k, n k) and add up, note is made T, compares T and T in the process of calculating and adding up 0Size, if before the picture element that travels through template image and subimage fully, obtain T 〉=T 0, then stop to calculate, and subimage is moved to next position, restart the calculating of a new round; If after traveling through the picture element of template image and subimage fully, obtain T<T 0, then upgrade threshold value T 0, and will this moment the coordinate position of subimage center pixel point (i j) notes, and obtains the horizontal range of i value and searched image vertical center line, remembers and makes x 2, get x 1With x 2Mean value as the best match position l of adjacent two width of cloth images i, i.e. l i=(x 1+ x 2)/2.
Further, at the delegation of the relevant position of whenever adding up or ε (i, j, the m of row k, n k) afterwards, with T and T 0Carry out size relatively.
Further again, in described (3.3),, be not directly to get I for spliced image N 'Value, but introduce a threshold k, at first calculate this gray-scale value before level and smooth and the difference of weighted mean value, if this is worth less than threshold value, then get I N 'Be the gray-scale value of this point, otherwise the sliding preceding gray-scale value of then making even is the gray-scale value of this point.
Further, in described step (1), the number of sequence image is no less than 12, and adjacent two width of cloth images must have lap, and lap is between 30% to 50%.
In described step (1), to take complete 360 degree look around the outdoor scene panorama or only the part visual angle look around the outdoor scene scene, a fixed position, horizontally rotate shooting by equal angles clockwise or counterclockwise.
In described step (1), the virtual shooting that 360 ° of three-dimensional contourings are showed for physical entity is placed on physical entity on equatorial telescope or the band scale rotating disk, and counterclockwise or clockwise direction equal angles ground rotation loading instrument dish is taken.
Technical conceive of the present invention is: the present invention proposes a kind of camera that utilizes and obtains one group of partly overlapping image sequence, generates panoramic picture by the pre-service of image, the splicing and the blending algorithm of image.Use general camera just can finish 360 ° of collecting works of looking around panorama sketch virtual scene structure required image, convenient and practical, be easy to popularize.Look around panorama sketch and realize fast, easy in view of 360 °, do not influence the authenticity that panoramic picture is browsed again; Therefore and only need 360 ° to look around for some scenes, look around panorama sketch very extensive applicability is just arranged for 360 °.
Beneficial effect of the present invention mainly shows: low for equipment requirements, general camera photo gets final product, with low cost, realize easy, intelligent degree height, processing speed is fast, panorama sketch is clear, need not complete space, strong sense of reality, applicability are wide, is easy to popularize and have extensive applicability.
Description of drawings
Fig. 1 is that 360 ° of the method for the invention generation are looked around panorama sketch sample image example.
Fig. 2 is by 2D image to 360 ° horizontal cylinder projective transformation synoptic diagram among the present invention.
Fig. 3 is the process flow diagram of merging algorithm for images.
Fig. 4 is 360 ° of generative process synoptic diagram of looking around panorama sketch.
Embodiment
Below in conjunction with accompanying drawing the present invention is further described.
With reference to Fig. 1~Fig. 4, a kind of based on serial static image 360 ° are looked around panorama generation method, and may further comprise the steps: (1) takes required sequence image with camera; (2) pre-service of sequence image; (3) splicing of sequence image.
Take required sequence image and be meant employing general camera camera lens, different scenes is adopted different one group of captured sequence images of image pickup method, every group of image is no less than 12 and adjacent two width of cloth images must have certain lap, and lap is between 30% to 50%.To take complete 360 degree look around the outdoor scene panorama or only the part visual angle look around the outdoor scene scene, a fixed position, horizontally rotate shooting by equal angles clockwise or counterclockwise.The virtual shooting that 360 ° of three-dimensional contourings are showed for physical entity is placed on physical entity on equatorial telescope or the band scale rotating disk, and counterclockwise or clockwise direction equal angles ground rotation loading instrument dish is taken.
In order to obtain effect panoramic picture preferably, present embodiment had proposed before image mosaic, to sequence image adopt medium filtering to carry out denoising, histogram equalization is handled, the influence that brings with balance illumination condition difference.We adopt following histogram equalization to handle transforming function transformation function:
s k = T ( r k ) = Σ i = 0 k n i n , k = 0,1,2 · · · , L - 1 - - - ( 3 )
Wherein, n is the sum of pixel in the image, n kBe that gray level is r kThe pixel number, L is a number of greyscale levels possible in the image, general value is 256.Is r by formula (3) with gray level in the input picture kPixel to be mapped as the output image gray level be s kCorresponding pixel.
After the pre-service of finishing image, thereby we finish by three steps and the splicing of 12 width of cloth images is finished one 360 ° look around the panorama map generalization, and these three steps are: the 1. conversion of image; 2. the coupling of image; 3. the smoothing processing of image.Method of the present invention at first will be carried out 360 ° of horizontal cylinder projective transformations to sequence image, the superimposed images of each projection plane is mapped to a standard projection promptly obtains 360 ° of horizontal cylinder projected images on 360 ° of horizontal cylindrical surface projectings.In the plane perspective projection, for a fixing viewpoint, the perspective transform on any two 2D planes can be finished by matrix multiple:
x ′ y ′ w ′ = m 0 m 1 m 2 m 3 m 4 m 5 m 6 m 7 m 8 x y w
Wherein, (x y) represents the pixel coordinates of first width of cloth image, (x ', y ') be (x, the y) respective coordinates on second width of cloth image at first project to 360 ° of horizontal cylinders of standard to picture shot by conversion, and the respective projection transformation for mula is:
Figure A20061005384200133
Wherein,
Figure A20061005384200134
k = r 2 + ( W 2 - x ) 2 , (x, y) be on the input picture more arbitrarily, (x 1, y 1) being the coordinate figure after this some process cylindrical surface projecting conversion, θ is a projection angle, and W is the width of image, and H is the height of image.
Referring to Fig. 2, the core of 360 ° of horizontal cylinder projective transformations is projective transformation formula, at first will set up coordinate system, all camera motions of supposition all occur in the X-Z plane shown in Fig. 2 (a), are the Z axle with the direction of observation of original input figure correspondence, view plane with original input picture place is the XY plane, the coordinate round dot is exactly the intersection point of the optical axis and the plane of delineation, and original input picture demarcation is I, and the cylindrical surface projecting image is demarcated and is J, the projection cylinder is demarcated and is that it is O (projection centre) that K, observation point demarcate.Be to observe the projection image J of image I on cylinder K at the O point now.
Fig. 2 (b) and Fig. 2 (c) are respectively the cylindrical surface projecting synoptic diagram of transverse observation direction (X-Z plane) and longitudinal 2 observation direction (Y-Z plane), demarcated two corresponding point M on original input picture and the cylindrical surface projecting image and the mutual alignment relation of N among the figure, and the situation of projection column radius surface, transverse observation angle α and longitudinal 2 observation angle β.
Sequential Similarity Detection Algorithm (the SSDA of a kind of adaptive thresholding value sequence that present embodiment proposes, Sequential Similarity Detection Algorithms), comprise size, template position and the hunting zone of determining the choosing of threshold value, template in this algorithm.At first, the absolute error function of definition image is:
ϵ ( i , j , m k , n k ) = | s i , j ( m k , n k ) - s ^ ( i , j ) - T ( m , n ) + T ^ | - - - ( 5 )
Wherein, s ^ ( i , j ) = 1 M 2 Σ m = 1 M Σ n = 1 M s i , j ( m , n ) , T ^ = 1 M 2 Σ m = 1 M Σ n = 1 M T ( m , n ) , T is a template, and S is searched figure, s I, jBe subgraph, that block search figure under promptly template covers, i, j are the coordinate of subgraph top left pixel point in S, M is the wide and high of template.
With reference to Fig. 3, in the preceding piece image of two width of cloth adjacent images that read in, all suitable image in a selected block size and position is as template, the horizontal range of the vertical center line of template center and place image remembered made x 1Afterwards, determine in the hunting zone (be the traversal scope of subgraph) of back in the piece image.All picture elements in the subimage of traversal template image and first position calculate ε (i, j, the m of corresponding picture element k, n k) and add up after with its initial value T as threshold value 0ε (i, j, the m of corresponding picture element in calculation template image and the next position subimage again k, n k) and add up, note is made T, compares T and T in the process of calculating and adding up 0Size.In order to accelerate to mate splicing speed, the delegation of relevant position or ε (i, j, the m of row add up whenever k, n k) afterwards, with T and T 0Carry out size relatively.For a certain position,, obtain T 〉=T if before the picture element that travels through template image and subimage fully 0, then stop to calculate, and subimage is moved to next position, restart the calculating of a new round.If after traveling through the picture element of template image and subimage fully, obtain T<T 0, then upgrade threshold value T 0, and will this moment the coordinate position of subimage center pixel point (i j) notes, and obtains the horizontal range of i value and searched image vertical center line, remembers and makes x 2Threshold value T 0Press the following formula value: T 0 = T T ≤ T 0 T 0 T > T 0 , In the hunting zone, travel through subimage like this, can find x 2Get x 1With x 2Mean value as the best match position l of adjacent two width of cloth images i, i.e. l i=(x 1+ x 2)/2.In like manner can try to achieve the best match position of every adjacent two width of cloth images in the sequence image.
Present embodiment is in order to make spliced image effect better, have more associative perception, propose the method that a kind of improved cum rights sews up and carry out spliced seamlessly transitting,, each pixel of its correspondence is synthesized to new image according to certain weights at the overlay region S and the T of two width of cloth adjacent images.The weights computing formula of each pixel on each image is as follows:
W Value = cos ( π 2 * | x - x 0 2 x 0 2 | ) * cos ( π 2 * | y - y 0 2 y 0 2 | ) - - - ( 1 )
W in the formula ValueThe expression weights, (x 0, y 0) be the center of intersection, (x y) is pixel coordinates.The overlapping region S of adjacent image and each pixel value of T correspondence are synthesized new image by certain weight.
The pixel value of intersection can be expressed as:
I N′=I N×W Value1+I N+1×W Value2 (2)
Wherein, I NAnd I N+1Represent the pixel value of the corresponding overlapping pixel of certain of two adjacent images in original image separately respectively, W Value1And W Value2The weights that are this pixels of calculating according to formula (1) on image separately, its span is (0,1), and and is 1.
For spliced image, be not directly to get I N 'Value, but introduce a threshold k, at first calculate this gray-scale value before level and smooth and the difference of weighted mean value, if this is worth less than threshold value, then get I N 'Be the gray-scale value of this point, otherwise the sliding preceding gray-scale value of then making even is the gray-scale value of this point.
As shown in Figure 4, be whole 360 ° of generative processes of looking around panoramic picture.At first different according to the different choice of captured scene styles of shooting is taken sequence image according to 401.To take complete 360 degree look around the outdoor scene panorama or only the part visual angle look around the outdoor scene scene, a fixed position, horizontally rotate shooting by equal angles clockwise or counterclockwise; The virtual shooting that 360 ° of three-dimensional contourings are showed for physical entity is placed on physical entity on equatorial telescope or the band scale rotating disk, and counterclockwise or clockwise direction equal angles ground rotation loading instrument dish is taken.Adjacent two width of cloth images will have certain overlappingly during shooting, and the number of Same Scene image are no less than 12.402 pairs of sequence images carry out image pre-service such as medium filtering denoising, histogram equalization processing, with the influence that balance illumination condition difference is brought, adopt histogram equalization to handle transforming function transformation function:
s k = T ( r k ) = Σ i = 0 k n i n , k = 0,1,2 · · · , L - 1 - - - ( 3 )
Wherein, n is the sum of pixel in the image, n kBe that gray level is r kThe pixel number, L is a number of greyscale levels possible in the image, general value is 256.Is r by formula (3) with gray level in the input picture kPixel to be mapped as the output image gray level be s kCorresponding pixel.
403 are mapped to a standard projection by 360 ° of horizontal cylinder projective transformation formula with the superimposed images of each projection plane promptly obtains 360 ° of horizontal cylindrical pictures on 360 ° of horizontal cylindrical surface projectings, and corresponding transformation for mula is:
Figure A20061005384200171
Wherein, k = r 2 + ( W 2 - x ) 2 , (x, y) be on the input picture more arbitrarily, (x 1, y 1) be the coordinate figure of this o'clock after through 360 ° of horizontal cylinder projective transformations, θ is a projection angle, and W is the width of image, and H is the height of image.
404 adopt the sequential Similarity Detection Algorithm of a kind of adaptive thresholding value sequence (SSDA), finish the amalgamation of adjacent two width of cloth images earlier, finally finish the amalgamation of one group of sequence image by same method.
405 is to eliminate vestige to adopt the method for improved cum rights stitching to carry out spliced seamlessly transitting, be not directly to adopt to be synthesized to new image in this step according to certain weights, but introduce a threshold value before, at first calculate this gray-scale value before level and smooth and the difference of weighted mean value, if this value is less than threshold value, then that this point is corresponding pixel is synthesized to new image by certain weights, otherwise the sliding preceding gray-scale value of then making even is the gray-scale value of this point.The panorama of finally finishing sequence image generates.

Claims (10)

1, a kind of based on serial static image 360 ° are looked around panorama generation method, and it is characterized in that: this method comprises the steps:
(1) takes required sequence image with camera;
(2) sequence image is carried out pre-service: adopt medium filtering to carry out denoising, histogram equalization is handled;
(3) splicing of sequence image: by with being spliced to form 360 ° and looking around panoramic picture of adjacent front and back image, may further comprise the steps:
(3.1) picture shot is projected to 360 ° of horizontal cylinders by conversion;
(3.2) in the preceding piece image of two width of cloth adjacent images that read in, select all suitable image in a block size and position as template, determine the hunting zone in the piece image of back, obtain the best match position l of adjacent two width of cloth images i, obtain in the sequence image best match position of every adjacent two width of cloth images successively;
(3.3), each pixel of its correspondence is synthesized to new image by certain weights at the overlapping region S and the T of two width of cloth adjacent images.The weights computing formula of each pixel on each image is as follows:
W Value = cos ( π 2 * | x - x 0 2 x 0 2 | ) * cos ( π 2 * | y - y 0 2 y 0 2 | ) - - - ( 1 )
W in the formula ValueThe expression weights, (x 0, y 0) be the center of intersection, (x y) is pixel coordinates;
The overlapping region S of adjacent image and each pixel value of T correspondence are synthesized new image by certain weight, and the pixel value of intersection can be expressed as:
I N′=I N×W Value1+I N+1×W Value2 (2)
Wherein, I NAnd I N+1The pixel value of pixel in original image separately of representing certain corresponding lap position of two adjacent images respectively, W Value1And W Value2The weights that are this pixels of calculating according to formula (1) on image separately, its span is (0,1), and and is 1.
2, a kind of based on serial static image 360 ° as claimed in claim 1 are looked around panorama generation method, it is characterized in that: in described (2), adopt histogram equalization to handle transforming function transformation function:
s k = T ( r k ) = Σ i = 0 k n i n , k = 0,1,2 · · · , L - 1 - - - ( 3 )
Wherein, n is the sum of pixel in the image, n kBe that gray level is r kThe pixel number, L is a number of greyscale levels possible in the image, general value is 256;
Is r by formula (3) with gray level in the input picture kPixel to be mapped as the output image gray level be s kCorresponding pixel.
3, a kind of based on serial static image 360 ° as claimed in claim 1 are looked around panorama generation method, and it is characterized in that: in described (3.1), 360 ° of horizontal cylinder projective transformation formula are:
Figure A2006100538420003C2
Wherein,
Figure A2006100538420003C3
k = r 2 + ( W 2 - x ) 2 , (x, y) be on the input picture more arbitrarily, (x 1, y 1) being the coordinate figure after this some process cylindrical surface projecting conversion, θ is a projection angle, and W is the width of image, and H is the height of image.
4, look around panorama generation method as described a kind of based on serial static image 360 ° of one of claim 1-3, it is characterized in that: in described (3.2), the absolute error function of definition image is:
ϵ ( i , j , m k , n k ) = | s i , j ( m k , n k ) - s ^ ( i , j ) - T ( m , n ) + T ^ | - - - ( 5 )
Wherein, s ^ ( i , j ) = 1 M 2 Σ m = 1 M Σ n = 1 M s i , j ( m , n ) , T ^ = 1 M 2 Σ m = 1 M Σ n = 1 M T ( m , n ) , T is a template, and S is searched figure, s I, jBe subgraph, that block search figure under promptly template covers, i, j are the coordinate of subgraph top left pixel point in S, M is the wide and high of template.
The horizontal range note of the vertical center line of template center and place image is made x iAfterwards, all picture elements in the subimage of traversal template image and first position calculate ε (i, j, the m of corresponding picture element k, n k) and add up after with its initial value T as threshold value 0
ε (i, j, the m of corresponding picture element in calculation template image and the next position subimage again k, n k) and add up, note is made T, compares T and T in the process of calculating and adding up 0Size, if before the picture element that travels through template image and subimage fully, obtain T 〉=T 0, then stop to calculate, and subimage is moved to next position, restart the calculating of a new round; If after traveling through the picture element of template image and subimage fully, obtain T<T 0, then upgrade threshold value T 0, and will this moment the coordinate position of subimage center pixel point (i j) notes, and obtains the horizontal range of i value and searched image vertical center line, remembers and makes x 2, get x 1With x 2Mean value as the best match position l of adjacent two width of cloth images i, i.e. l i=(x 1+ x 2)/2.
5, a kind of based on serial static image 360 ° as claimed in claim 4 are looked around panorama generation method, and it is characterized in that: the delegation of relevant position or ε (i, j, the m of row add up whenever k, n k) afterwards, with T and T 0Carry out size relatively.
6, a kind of based on serial static image 360 ° as claimed in claim 5 are looked around panorama generation method, it is characterized in that: in described (3.3), for spliced image, be not directly to get I N 'Value, but introduce a threshold k, at first calculate this gray-scale value before level and smooth and the difference of weighted mean value, if this is worth less than threshold value, then get I N 'Be the gray-scale value of this point, otherwise the sliding preceding gray-scale value of then making even is the gray-scale value of this point.
7, look around panorama generation method as described a kind of based on serial static image 360 ° of one of claim 1-3, it is characterized in that: in described (1), the number of sequence image is no less than 12, and adjacent two width of cloth images must have lap, and lap is between 30% to 50%.
8, a kind of based on serial static image 360 ° as claimed in claim 4 are looked around panorama generation method, it is characterized in that: in described (1), the number of one group of sequence image is no less than 12, and adjacent two width of cloth images must have lap, and lap is between 30% to 50%.
9, a kind of based on serial static image 360 ° as claimed in claim 8 are looked around panorama generation method, it is characterized in that: in described (1), to take complete 360 degree look around the outdoor scene panorama or only the part visual angle look around the outdoor scene scene, a fixed position, horizontally rotate shooting by clockwise or counter clockwise direction equal angles.
10, a kind of based on serial static image 360 ° as claimed in claim 8 are looked around panorama generation method, it is characterized in that: in described (1), the virtual shooting that 360 ° of three-dimensional contourings are showed for physical entity, physical entity is placed on equatorial telescope or the band scale rotating disk, and counterclockwise or clockwise direction equal angles ground rotation loading instrument dish is taken.
CNB2006100538429A 2006-10-13 2006-10-13 360 degree around panorama generation method based on serial static image Expired - Fee Related CN100485720C (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CNB2006100538429A CN100485720C (en) 2006-10-13 2006-10-13 360 degree around panorama generation method based on serial static image

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CNB2006100538429A CN100485720C (en) 2006-10-13 2006-10-13 360 degree around panorama generation method based on serial static image

Publications (2)

Publication Number Publication Date
CN101079151A true CN101079151A (en) 2007-11-28
CN100485720C CN100485720C (en) 2009-05-06

Family

ID=38906616

Family Applications (1)

Application Number Title Priority Date Filing Date
CNB2006100538429A Expired - Fee Related CN100485720C (en) 2006-10-13 2006-10-13 360 degree around panorama generation method based on serial static image

Country Status (1)

Country Link
CN (1) CN100485720C (en)

Cited By (38)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101895693A (en) * 2010-06-07 2010-11-24 北京高森明晨信息科技有限公司 Method and device for generating panoramic image
CN101594533B (en) * 2009-06-30 2010-12-29 华中科技大学 Method suitable for compressing sequence images of unmanned aerial vehicle
CN101984463A (en) * 2010-11-02 2011-03-09 中兴通讯股份有限公司 Method and device for synthesizing panoramic image
CN102013110A (en) * 2010-11-23 2011-04-13 李建成 Three-dimensional panoramic image generation method and system
CN101540046B (en) * 2009-04-10 2011-07-27 凌阳电通科技股份有限公司 Panoramagram montage method and device based on image characteristics
CN102143305A (en) * 2010-02-02 2011-08-03 华为终端有限公司 Image pickup method and system
CN102201115A (en) * 2011-04-07 2011-09-28 湖南天幕智能科技有限公司 Real-time panoramic image stitching method of aerial videos shot by unmanned plane
CN102308276A (en) * 2008-12-03 2012-01-04 宣江 Displaying objects with certain visual effects
CN101601239B (en) * 2007-01-22 2012-07-11 艾利森电话股份有限公司 Method and system for using user equipment to compose an ad-hoc mosaic
CN102739954A (en) * 2011-03-31 2012-10-17 卡西欧计算机株式会社 Imaging device capable of combining images
CN102902485A (en) * 2012-10-25 2013-01-30 北京华达诺科技有限公司 360-degree panoramic multi-point touch display platform establishment method
CN102999891A (en) * 2011-09-09 2013-03-27 中国航天科工集团第三研究院第八三五八研究所 Binding parameter based panoramic image mosaic method
CN103514581A (en) * 2013-10-23 2014-01-15 小米科技有限责任公司 Screen picture capturing method, device and terminal equipment
CN103533149A (en) * 2012-07-02 2014-01-22 北京赛佰特科技有限公司 Mobile phone robot system and application method thereof
WO2014100985A1 (en) * 2012-12-26 2014-07-03 Harman International Industries, Incorporated Method and system for generating a surround view
CN103945103A (en) * 2013-01-17 2014-07-23 成都国腾电子技术股份有限公司 Multi-plane secondary projection panoramic camera image distortion elimination method based on cylinder
CN103985134A (en) * 2014-06-04 2014-08-13 无锡观智视觉科技有限公司 Detection method for panoramic calibration synthesis effect
CN104077764A (en) * 2014-07-11 2014-10-01 金陵科技学院 Panorama synthetic method based on image mosaic
CN105128743A (en) * 2015-09-07 2015-12-09 深圳市灵动飞扬科技有限公司 Vehicle panoramic display method and system
CN105741239A (en) * 2014-12-11 2016-07-06 合肥美亚光电技术股份有限公司 Method and apparatus for generating tooth panorama image, and panorama machine for shooting teeth
CN105933695A (en) * 2016-06-29 2016-09-07 深圳市优象计算技术有限公司 Panoramic camera imaging device and method based on high-speed interconnection of multiple GPUs
CN105957015A (en) * 2016-06-15 2016-09-21 武汉理工大学 Thread bucket interior wall image 360 DEG panorama mosaicing method and system
CN106303405A (en) * 2014-07-23 2017-01-04 威视恩移动有限公司 The method and system of instant image are provided by wireless communication channel
CN106296588A (en) * 2016-08-25 2017-01-04 成都索贝数码科技股份有限公司 A kind of method of VR video editing based on GPU
CN106331675A (en) * 2016-08-23 2017-01-11 王庆丰 Image processing and projecting method and device, and imaging system
WO2017113533A1 (en) * 2015-12-30 2017-07-06 完美幻境(北京)科技有限公司 Panoramic photographing method and device
CN107132661A (en) * 2017-05-24 2017-09-05 北京视叙空间科技有限公司 A kind of bore hole 3D display devices
CN107274341A (en) * 2017-05-18 2017-10-20 合肥工业大学 Quick binocular flake Panorama Mosaic method based on fixed splicing parameter
CN107610045A (en) * 2017-09-20 2018-01-19 北京维境视讯信息技术有限公司 Luminance compensation method, device, equipment and storage medium in the splicing of flake picture
CN107851333A (en) * 2015-07-28 2018-03-27 株式会社日立制作所 Video generation device, image generation system and image generating method
CN107845111A (en) * 2017-11-21 2018-03-27 北京工业大学 The generation method of annulus viewing area in a kind of infrared panorama monitoring
CN108986183A (en) * 2018-07-18 2018-12-11 合肥亿图网络科技有限公司 A kind of production method of panoramic table
WO2020007094A1 (en) * 2018-07-02 2020-01-09 浙江大学 Panoramic image filtering method and device
CN111024431A (en) * 2019-12-26 2020-04-17 江西交通职业技术学院 Bridge rapid detection vehicle based on multi-sensor unmanned driving
CN111757087A (en) * 2020-06-30 2020-10-09 北京金山云网络技术有限公司 VR video processing method and device and electronic equipment
CN112070886A (en) * 2020-09-04 2020-12-11 中车大同电力机车有限公司 Image monitoring method and related equipment for mining dump truck
CN112529028A (en) * 2019-09-19 2021-03-19 北京声迅电子股份有限公司 Networking access method and device for security check machine image
CN111858811B (en) * 2020-07-20 2023-07-28 北京百度网讯科技有限公司 Method and device for constructing interest point image, electronic equipment and storage medium

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107424118A (en) * 2017-03-28 2017-12-01 天津大学 Based on the spherical panorama mosaic method for improving Lens Distortion Correction

Cited By (58)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101601239B (en) * 2007-01-22 2012-07-11 艾利森电话股份有限公司 Method and system for using user equipment to compose an ad-hoc mosaic
CN102308276B (en) * 2008-12-03 2014-12-17 轩江 Displaying objects with certain visual effects
US9094632B2 (en) 2008-12-03 2015-07-28 Measureout, Llc Displaying objects with certain visual effects
CN102308276A (en) * 2008-12-03 2012-01-04 宣江 Displaying objects with certain visual effects
CN101540046B (en) * 2009-04-10 2011-07-27 凌阳电通科技股份有限公司 Panoramagram montage method and device based on image characteristics
CN101594533B (en) * 2009-06-30 2010-12-29 华中科技大学 Method suitable for compressing sequence images of unmanned aerial vehicle
CN102143305B (en) * 2010-02-02 2013-11-06 华为终端有限公司 Image pickup method and system
CN102143305A (en) * 2010-02-02 2011-08-03 华为终端有限公司 Image pickup method and system
CN101895693A (en) * 2010-06-07 2010-11-24 北京高森明晨信息科技有限公司 Method and device for generating panoramic image
CN101984463A (en) * 2010-11-02 2011-03-09 中兴通讯股份有限公司 Method and device for synthesizing panoramic image
CN102013110B (en) * 2010-11-23 2013-01-02 李建成 Three-dimensional panoramic image generation method and system
CN102013110A (en) * 2010-11-23 2011-04-13 李建成 Three-dimensional panoramic image generation method and system
CN102739954A (en) * 2011-03-31 2012-10-17 卡西欧计算机株式会社 Imaging device capable of combining images
CN102739954B (en) * 2011-03-31 2015-04-01 卡西欧计算机株式会社 Imaging device capable of combining images
CN102201115A (en) * 2011-04-07 2011-09-28 湖南天幕智能科技有限公司 Real-time panoramic image stitching method of aerial videos shot by unmanned plane
CN102999891A (en) * 2011-09-09 2013-03-27 中国航天科工集团第三研究院第八三五八研究所 Binding parameter based panoramic image mosaic method
CN103533149A (en) * 2012-07-02 2014-01-22 北京赛佰特科技有限公司 Mobile phone robot system and application method thereof
CN102902485A (en) * 2012-10-25 2013-01-30 北京华达诺科技有限公司 360-degree panoramic multi-point touch display platform establishment method
WO2014100985A1 (en) * 2012-12-26 2014-07-03 Harman International Industries, Incorporated Method and system for generating a surround view
CN104937634A (en) * 2012-12-26 2015-09-23 哈曼国际工业有限公司 Method and system for generating surround view
CN104937634B (en) * 2012-12-26 2018-04-03 哈曼国际工业有限公司 For generating the method and system around view
US10075634B2 (en) 2012-12-26 2018-09-11 Harman International Industries, Incorporated Method and system for generating a surround view
CN103945103A (en) * 2013-01-17 2014-07-23 成都国腾电子技术股份有限公司 Multi-plane secondary projection panoramic camera image distortion elimination method based on cylinder
CN103514581A (en) * 2013-10-23 2014-01-15 小米科技有限责任公司 Screen picture capturing method, device and terminal equipment
CN103514581B (en) * 2013-10-23 2017-02-15 小米科技有限责任公司 Screen picture capturing method, device and terminal equipment
CN103985134B (en) * 2014-06-04 2017-04-05 无锡维森智能传感技术有限公司 It is a kind of to look around the detection method for demarcating synthetic effect
CN103985134A (en) * 2014-06-04 2014-08-13 无锡观智视觉科技有限公司 Detection method for panoramic calibration synthesis effect
CN104077764A (en) * 2014-07-11 2014-10-01 金陵科技学院 Panorama synthetic method based on image mosaic
CN106303405A (en) * 2014-07-23 2017-01-04 威视恩移动有限公司 The method and system of instant image are provided by wireless communication channel
CN105741239A (en) * 2014-12-11 2016-07-06 合肥美亚光电技术股份有限公司 Method and apparatus for generating tooth panorama image, and panorama machine for shooting teeth
US10602996B2 (en) 2014-12-11 2020-03-31 Hefei Meyer Optoelectronic Technology Inc. Method and apparatus for generating dental panoramic image, and panoramic camera for photographing teeth
CN105741239B (en) * 2014-12-11 2018-11-30 合肥美亚光电技术股份有限公司 Generation method, device and the panorama machine for shooting tooth of tooth panoramic picture
CN107851333A (en) * 2015-07-28 2018-03-27 株式会社日立制作所 Video generation device, image generation system and image generating method
CN105128743A (en) * 2015-09-07 2015-12-09 深圳市灵动飞扬科技有限公司 Vehicle panoramic display method and system
WO2017113533A1 (en) * 2015-12-30 2017-07-06 完美幻境(北京)科技有限公司 Panoramic photographing method and device
CN105957015A (en) * 2016-06-15 2016-09-21 武汉理工大学 Thread bucket interior wall image 360 DEG panorama mosaicing method and system
CN105957015B (en) * 2016-06-15 2019-07-12 武汉理工大学 A kind of 360 degree of panorama mosaic methods of threaded barrel inner wall image and system
CN105933695A (en) * 2016-06-29 2016-09-07 深圳市优象计算技术有限公司 Panoramic camera imaging device and method based on high-speed interconnection of multiple GPUs
CN106331675A (en) * 2016-08-23 2017-01-11 王庆丰 Image processing and projecting method and device, and imaging system
CN106331675B (en) * 2016-08-23 2018-09-25 王庆丰 Image processing, projective techniques, device and imaging system
CN106296588B (en) * 2016-08-25 2019-04-12 成都索贝数码科技股份有限公司 A method of the VR video editing based on GPU
CN106296588A (en) * 2016-08-25 2017-01-04 成都索贝数码科技股份有限公司 A kind of method of VR video editing based on GPU
CN107274341A (en) * 2017-05-18 2017-10-20 合肥工业大学 Quick binocular flake Panorama Mosaic method based on fixed splicing parameter
CN107132661A (en) * 2017-05-24 2017-09-05 北京视叙空间科技有限公司 A kind of bore hole 3D display devices
CN107610045B (en) * 2017-09-20 2021-02-05 北京字节跳动网络技术有限公司 Brightness compensation method, device and equipment in fisheye picture splicing and storage medium
CN107610045A (en) * 2017-09-20 2018-01-19 北京维境视讯信息技术有限公司 Luminance compensation method, device, equipment and storage medium in the splicing of flake picture
CN107845111B (en) * 2017-11-21 2021-06-25 北京工业大学 Method for generating middle-loop display area in infrared panoramic monitoring
CN107845111A (en) * 2017-11-21 2018-03-27 北京工业大学 The generation method of annulus viewing area in a kind of infrared panorama monitoring
WO2020007094A1 (en) * 2018-07-02 2020-01-09 浙江大学 Panoramic image filtering method and device
CN108986183A (en) * 2018-07-18 2018-12-11 合肥亿图网络科技有限公司 A kind of production method of panoramic table
CN108986183B (en) * 2018-07-18 2022-12-27 合肥亿图网络科技有限公司 Method for manufacturing panoramic map
CN112529028B (en) * 2019-09-19 2022-12-02 北京声迅电子股份有限公司 Networking access method and device for security check machine image
CN112529028A (en) * 2019-09-19 2021-03-19 北京声迅电子股份有限公司 Networking access method and device for security check machine image
CN111024431A (en) * 2019-12-26 2020-04-17 江西交通职业技术学院 Bridge rapid detection vehicle based on multi-sensor unmanned driving
CN111024431B (en) * 2019-12-26 2022-03-11 江西交通职业技术学院 Bridge rapid detection vehicle based on multi-sensor unmanned driving
CN111757087A (en) * 2020-06-30 2020-10-09 北京金山云网络技术有限公司 VR video processing method and device and electronic equipment
CN111858811B (en) * 2020-07-20 2023-07-28 北京百度网讯科技有限公司 Method and device for constructing interest point image, electronic equipment and storage medium
CN112070886A (en) * 2020-09-04 2020-12-11 中车大同电力机车有限公司 Image monitoring method and related equipment for mining dump truck

Also Published As

Publication number Publication date
CN100485720C (en) 2009-05-06

Similar Documents

Publication Publication Date Title
CN100485720C (en) 360 degree around panorama generation method based on serial static image
CN111062873B (en) Parallax image splicing and visualization method based on multiple pairs of binocular cameras
CN109003325B (en) Three-dimensional reconstruction method, medium, device and computing equipment
Wang et al. 360sd-net: 360 stereo depth estimation with learnable cost volume
CN111028155B (en) Parallax image splicing method based on multiple pairs of binocular cameras
CN107578376B (en) Image splicing method based on feature point clustering four-way division and local transformation matrix
TW202004679A (en) Image feature extraction method and saliency prediction method including the same
CN1897715A (en) Three-dimensional vision semi-matter simulating system and method
CN106504321A (en) Method using the method for photo or video reconstruction three-dimensional tooth mould and using RGBD image reconstructions three-dimensional tooth mould
CN106485207B (en) A kind of Fingertip Detection and system based on binocular vision image
JP7357676B2 (en) System and method for performing self-improving visual odometry
CN105933695A (en) Panoramic camera imaging device and method based on high-speed interconnection of multiple GPUs
CN1930585A (en) Creating a depth map
Xu et al. Semantic segmentation of panoramic images using a synthetic dataset
Li et al. Read: Large-scale neural scene rendering for autonomous driving
CN110633628B (en) RGB image scene three-dimensional model reconstruction method based on artificial neural network
CN108776989A (en) Low texture plane scene reconstruction method based on sparse SLAM frames
CN108399634B (en) RGB-D data generation method and device based on cloud computing
CN1878318A (en) Three-dimensional small-sized scene rebuilding method based on dual-camera and its device
CN1204532C (en) Method and apparatus for rendering images with refractions
CN114863038A (en) Real-time dynamic free visual angle synthesis method and device based on explicit geometric deformation
CN105631859A (en) Three-degree of freedom bionic stereo vision system
CN108734773A (en) A kind of three-dimensional rebuilding method and system for mixing picture
CN1272750C (en) Intelligent panorama creating process based on two fish-eye images
CN108616746A (en) The method that 2D panoramic pictures based on deep learning turn 3D panoramic pictures

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant
C17 Cessation of patent right
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20090506

Termination date: 20131013