CN1090357C - Image connecting system and method for ring field image type virtual environment - Google Patents

Image connecting system and method for ring field image type virtual environment Download PDF

Info

Publication number
CN1090357C
CN1090357C CN 98103910 CN98103910A CN1090357C CN 1090357 C CN1090357 C CN 1090357C CN 98103910 CN98103910 CN 98103910 CN 98103910 A CN98103910 A CN 98103910A CN 1090357 C CN1090357 C CN 1090357C
Authority
CN
China
Prior art keywords
image
twisted
solution
predetermined threshold
threshold value
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CN 98103910
Other languages
Chinese (zh)
Other versions
CN1222711A (en
Inventor
谢君伟
程治
江政钦
黄书政
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Transpacific IP Pte Ltd.
Original Assignee
Industrial Technology Research Institute ITRI
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Industrial Technology Research Institute ITRI filed Critical Industrial Technology Research Institute ITRI
Priority to CN 98103910 priority Critical patent/CN1090357C/en
Publication of CN1222711A publication Critical patent/CN1222711A/en
Application granted granted Critical
Publication of CN1090357C publication Critical patent/CN1090357C/en
Anticipated expiration legal-status Critical
Expired - Fee Related legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G07CHECKING-DEVICES
    • G07DHANDLING OF COINS OR VALUABLE PAPERS, e.g. TESTING, SORTING BY DENOMINATIONS, COUNTING, DISPENSING, CHANGING OR DEPOSITING
    • G07D5/00Testing specially adapted to determine the identity or genuineness of coins, e.g. for segregating coins which are unacceptable or alien to a currency
    • G07D5/02Testing the dimensions, e.g. thickness, diameter; Testing the deformation

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Image Processing (AREA)

Abstract

The present invention relates to a system and a method for connecting multiple adjacent images with each other to form a large panoramic field surrounding figure, which is used for constructing a virtual environment through the panoramic figure. The method comprises the following steps that input images are twisted or projected onto an especial digital model; useful vertical sides or horizontal sides are respectively sought in the first twisted image and the second twisted image to the last image, and the positions of the vertical sides or the horizontal sides are recorded; a group of possible homographic solutions can be found from the positions of the sides; the optimum joint can be quickly determined through correlation matching so that two adjacent figures can be connected with each other. Compared with the traditional methods, the method of the present invention is obviously improved in terms of speed and stability.

Description

A kind of ring field image type virtual environment image connecting system and method
The present invention relates generally to a kind of map interlinking instrument, utilizes this map interlinking instrument, can construct a ring field image type virtual environment at an easy rate.
In this real world, present this and adopt the colourful world more, image is best instrument.Past in PC World, mainly presents the natural landscape of real world with the mode of drawing, in drops at leisure the scene drawing that will show is come out with lines.And this mode need spend many manpowers and time, and needs special and expensive computer equipment to show the scene of wanting to show via computing machine in real time, though interactive high shortcoming is many.Therefore, just the someone wants directly to come the constructing virtual environment with image.This mode has many benefits, and at first, needed computer equipment does not need too expensive, even personal computer just can obtain effect very true to nature.Moreover it is irrelevant to make up a virtual world manpower of spending and the scenery that will make up, no matter how complicated background is, computing machine institute's time spent is all the same.Utilize image to make up a virtual world, at first will utilize camera, it is fixed on the turning axle, then a circle is clapped in scenery ring field, just can obtain a series of image.In order to eliminate the problem of camera lens distortion (perspective distortion), before map interlinking, must be on some mathematical models (column type or ball-type) these image projection; Utilize the map interlinking device that these figure are joined together to constitute a ring field image then; Utilize this image just can construct a virtual world of real world.
Ring field image has many application in practice, for example can be applicable in film trick, electronic game, virtual shopping or the education.Make up this ring field pattern, maximum problem is exactly how a series of figure that taken by camera to be conspired to create one.A very natural method is with manual mode these figure to be connected together, and this mode is not too convenient, especially when a lot of images will connect, wastes time and energy especially.Therefore utilizing the automatic map interlinking of computing machine is a kind of relatively convenient mode.
Before these images were connected together, in order to overcome the problem that image twists because of camera lens, the image of input must project to some mathematical models, and this mathematical model can be ball-type (spherical) or column type (cylindrical).In actual applications, when being projected in data storage, ball-type can meet some problems, because in PC World, if image is near rectangle then than being easier to storage.Another problem is the bad arrangement of camera, and the position is put inappropriately a little, very big distortion and difference are just arranged between image, and this can cause the difficulty of map interlinking.For the foregoing reasons, in making up virtual world, the most frequently used to projection pattern be face of cylinder projection (cylindrical projection).
With reference to figure 2, face of cylinder projection mathematics model can be described in detail as follows: rectangle PQRS is used for presentation video plane 10, rectangle pqrs is used for representing the cylinder plane 12 (cylindrical plane) supposed, mirror axle center is O, PQRS will be projected to pqrs, the plane of delineation 10 circumscribed cylinder planes 12, and the plane of delineation 10 central points are O ', lens length is f, and the radius on cylinder plane is d.Suppose P (x, y) be on the plane of delineation 10 a bit, and P (u, v) be P (x, the y) corresponding point on cylinder plane 12, with reference to figure 2, coordinate (u v) can be expressed as follows: u = d ∠ O ′ OB = d tan - 1 O ′ B ‾ O O ′ ‾ = d tan - 1 x f , - - - ( 1 ) With v = d PB ‾ OB ‾ = d y x 2 + f 2 - - - ( 2 ) In fact, radius d equals f, so equation (1) and (2) can be rewritten as follows: u = f tan - 1 x f , - - - ( 3 ) With v = f y x 2 + f 2 - - - - ( 4 ) Based on equation (3) and (4), can camera take the photograph image projection to some cylinders plane, utilize map interlinking device of the present invention again, just can be connected into a complete ring field image to the image of input.
Fundamental purpose of the present invention is to provide a kind of intelligent map interlinking device, utilize this map interlinking device can take the photograph by camera a series of images utmost point be connected together effectively, thereby constitute a complete ring field image.The present invention mainly is an information of utilizing image limit (edges), and a series of different images are connect.The present invention also proposes a kind of method, it utilizes the information on image limit, find out a series of possible homographic solutions (matching solutions), again by these possible separating, utilize relevant matches (correlation matching) to determine separating of last the best, utilize this optimum solution, just can be joined together adjacent different image.Because the number of this group feasible solution seldom, can find out separating at last with utmost point effective and efficient manner.
In the present invention, when two images are bonded together, at first need they are projected on some faces of cylinder, so-called distortion that Here it is (warping) computing, then from these two images that twisted, seek the information on limits (edges) individually, and the location records on these limits is got off.Utilize the position on these limits, can obtain one group of possible corresponding point and separate.Then from this group is separated, can effectively utilize very much relevant matches and find finally and separate.When find finally separate after, because the brightness of these two images is inconsistent, must do so-called mixing (blending) computing, promptly utilize on the image any brightness and the brightness of its corresponding point on another image, be weighted on average according to their distances from the border, thereby after two images become one, seem very level and smooth in the brightness of seam crossing.
Characteristics of the present invention are, when detecting the vertical edges (vertical edges) of an image, can utilize the summation of each row (column) pixels (pixels) Grad (gradient intensty value) in the image to determine, promptly each pixel of each row in the image be calculated its Grad respectively; In addition summation is average to all Grad of pixel of this row then, and this mean value is compared with a pre-set threshold again; If this mean value is bigger than threshold value, then this shows the existence of a vertical edges; Each row is all done this computing, just can find out all vertical edges.
Similarly, when seeking the horizontal sides (horizontal edges) of an image, can utilize the summation of each row (row) pixel gradient value of image to decide, promptly each pixel of each row in the image be calculated its Grad respectively; In addition summation is average to all Grad of pixel of this delegation then, and this mean value is compared with a pre-set threshold again; If this mean value is bigger than threshold value, then this delegation can be considered the existence that a horizontal sides is arranged; This computing is done in each provisional capital, just can find out all horizontal sides.
Utilize vertical edges, can infer needed homographic solution (matching solutions) possible coordinate on the x axle; Usually, utilize so-called displacement function (offset function) to produce possible the separating of this group.It is defined as follows: d ( i , k ) = min 1 ≤ j ≤ N b | P a ( i ) - k - P b ( j ) | , Wherein: P a(i) be illustrated in the position that a opens i bar vertical edges in the warp image (warped image);
P b(j) be illustrated in the position that b opens j bar vertical edges in the warp image;
N bBe illustrated in the number that b opens vertical edges in the warp image; With
K is a variable of user's definition.Suppose N p(i, k) value is less than a predetermined threshold value (threshold) T to represent all to open its displacement function d in the warp image at a 0The limit number of vertical edges, (i, k) value is less than a predetermined threshold value T by these its d 0Vertical edges, can obtain d (i, a mean value A (k) k).If A (k) value is less than a predetermined threshold (threshold) T 1, and N pGreater than another predetermined threshold value (threshold) T 2, the k position just can be considered the coordinate of a possible homographic solution on the x direction so.Provide different value of K, just can find out the coordinate of all possible homographic solution on the x direction.
According to a further aspect in the invention, the invention provides a kind of being used for and effectively the image of input is connected into a holonomic system of encircling field pattern, this system comprises an edge detector (edge detector), be used for detecting a and open the horizontal or vertical limit of image and open horizontal or vertical limit corresponding in the image at b, this edge detector writes down the position of these vertical edges or horizontal sides simultaneously.This system also comprises a storer, is used for storing the position data on these horizontal or vertical limits, so that further handle.This system comprises a feasible solution generator (hypothesis generator) and optimum solution selector switch (optimum hypothesisselector) simultaneously, the position that the feasible solution generator is mainly used to the horizontal or vertical limit from be stored in storer produces a series of possible homographic solutions, and the optimum solution selector switch then is used for utilizing relevant matches to select best separating from possible the separating of this group.
Specifically, this system utilizes storer to come recording image data, and this system comprises a mixing engine (blending engine), is used for the difference of brightness between smoothed image.When two images are joined together, common overlapping region (common overlapping area) must be arranged.Because the difference of photograph situation, the inevitable difference of overlapping region brightness that these two images are common, can take out some pixels from an image, simultaneously take out its corresponding pixel at another image, be weighted on average according to their distances, thereby make two images very level and smooth in the brightness of common overlapping areas from the border.In this system, edge detector (edge detector), feasible solution generator (hypothesis selector), optimum solution selector switch (optimalhypothesis selector) all can be included in the microprocessor.In addition, can utilize outside storer (as hard disk) to write down the image (warped images) that twisted.
The present invention also provides a kind of prediction will be by the method for the feasible solution of map interlinking.It utilizes the information on the horizontal or vertical limit in the image to predict possible the separating of this group basically.Because infer that accurately the number that this group is separated is very little, therefore the scope of searching is reduced widely, thereby can find out finally very soon and separate.When searching is finally separated, utilize so-called relevant matches finally to be separated.Because the relevant matches spended time is more, the invention provides a method of cutting out (pruningmethod) that is used for removing in advance unnecessary relevant matches.The principle of this method of cutting out is if the value of current relevant matches less than the value of a predefined, then need not further be mated, therefore can remove some unnecessary couplings in advance.This method of cutting out can reduce the calculating of a lot of relevant matches, has therefore improved the efficient of map interlinking greatly.Compare with traditional method, the present invention has not only had tangible improvement aspect efficient but also aspect reliability, and this mainly is because can predict possible homographic solution in advance, owing to infer that set accurate and that this group is separated is very little, can find out optimum solution soon.
The present invention may be used on many aspects, for example virtual environment, guide system, electronic game, Geographic Information System, film trick etc.
By reference accompanying drawing detailed description of the present invention, purpose of the present invention, feature and advantage will become more obvious, in the accompanying drawing:
Fig. 1 represents to utilize image to produce the systematic analysis figure of virtual environment;
Fig. 2 is the geometric graph that is used for illustrating conic projection;
Fig. 3 is the system schematic that realizes method of the present invention;
Fig. 4 A and 4B illustrate the operation of Fig. 3 system with an example;
Fig. 5 is used for the how brightness between level and smooth two images of (blending) technology of explain mixing; With
Computer organization that realizes Fig. 3 method of Fig. 6.
Fig. 3 represents whole image connecting system 20, and its cardinal principle is to utilize the information on limit (edgeinformation) to determine last optimum solution.At first, utilize edge detector 22 from image, to obtain the position of vertical edges and horizontal sides.Obtain after these positions, utilize feasible solution generator 24 to obtain a series of feasible solutions.Then, utilize optimum solution selector switch 26 that this group each in feasible solution is separated and do last affirmation, separate thereby find out at last effectively.Utilize this finally to separate then, individually adjacent image is bonded together.In order to eliminate the uncontinuity of brightness between individual image, can utilize and mix the problem that engine 28 solves this brightness uncontinuity.
In this image connecting system, edge detector only uses vertical edges and horizontal sides to predict homographic solution possible between the adjacent image in advance.Suppose g x(p) (its clear and definite expression is g for i, the j) Grad on the x direction to represent some pixel p in the image x(p (i, j))=| and I (p (i+1, j))-I (p (i-1, j)) |, wherein I (p) is the brightness value of pixel p in image.When the detection of vertical limit, edge detector is to their Grad of pixel accumulation at same row.There is a vertical edges in these row if this accumulated value greater than the threshold value of a predefined, is then assert, and utilizes mark to write down the existence of this vertical edges.After having detected all row, can obtain the position of all vertical edges.Available identical method is sought the position of horizontal sides.
With reference to figure 4A and Fig. 4 B, giving one example illustrates.Suppose other image I aAnd I bBe bonded together, can utilize rim detection from I aIn obtain following vertical edges: (100, y), (115, y), (180, y), (200, y), (310, y), (325, y), (360, y), (390, y) and (470, y), also can be from I bIn obtain following vertical edges: (20, y), (35, y), (100, y), (120, y), (230, y), (245, y), (280, y), (310, y) and (390, y).By these vertical edges, can only utilize their coordinates on the x direction to obtain two groups of coordinate figures, i.e. P a=(100,115,180,200,310,325,360,390,470) and P b=(20,35,100,120,230,245,280,310,390).Because these vertical edges correspond to each other, P aAnd P bSatisfy following relationship: P a(i)=P b(j)+d x, wherein i is corresponding one by one with j, d xBe P aAnd P bBetween deviation (offset).Clearly, d xBe the homographic solutions (matchedsolution) of these two adjacent images on the x direction.But, may can not find or confuse under certain conditions, at I owing to there is noise aAnd I bSome vertical edges, this causes P aAnd P bBetween no longer be to concern one to one.Therefore in the present invention, propose a kind of feasible solution generator, be used for finding out possible homographic solution on the x direction from the information of these vertical edges.
Suppose N aAnd N bWrite down P respectively aAnd P bIn element number, and make displacement function d ( i , k ) = min 1 ≤ j ≤ N b | P a ( i ) - k - P b ( j ) | . A given value k, then the feasible solution generator calculates at P a(i is k) less than a prior predetermined threshold value T for its d in the set 0Element number.Suppose that this number is N p, suppose also that in addition (i, mean value k) are A (k), if A (k) is less than second prior predetermined threshold value T for the d of the element that these satisfy condition 1, and N pGreater than the 3rd threshold value T 2, then this position k is regarded as the coordinate figure of a possibility homographic solution on directions X.Different k is provided, just has one group may produce by homographic solution.Notice that this feasible solution is the possible coordinate figure on the x direction just, the set that makes this feasible solution is S xIn this solution procedure, three pre-set threshold T 0, T 1, T 2By the experiment gained, and all the same to all images.
Also can be in a like fashion on horizontal sides.Utilize horizontal sides, can obtain the coordinate of possible homographic solution on the y direction.Suppose that these possible y coordinates constitute a S set xBecause S xAnd S yThe element of this set is few, finally separates to be obtained soon by the optimum solution selector switch.
The optimum solution selector switch is mainly used to from S xAnd S yTwo union of sets collection { S=(x, y) | x ∈ S x, y ∈ S yIn determine optimum solution.The optimum solution selector switch mainly utilizes relevant matches to determine optimum solution.In the method for relevant matches, relatively Chang Yong evaluation function (measure function) has two, one is mean absolute difference MAE (mean absolute error), and another is canonical simple crosscorrelation (normalizedcross-correlation), can be with reference to the paper of L.G.Broum.Their definition is as follows respectively: D ( p ; q ) = 1 ( 2 M + 1 ) 2 Σ x , y = - M x , y = M | I 1 ( x + p x , y + p y ) - I 2 ( x + q x , y + q y ) | With C ( p ; q ) = 1 σ 1 σ 2 ( 2 M + 1 ) 2 Σ x , y = - M x , y = M [ I 1 ( x + p x , y + p y ) - u 1 ] [ I 2 ( x + q x , y + q y ) - u 2 ]
U wherein iWith σ i be image I iMean value and variable quantity.(2M+1) 2The area of expression coupling form.Though these two evaluation functions all are applicable to definite optimum solution, but when speed is not most important reference quantity, canonical simple crosscorrelation coupling is a reasonable selection, because it can tolerate the difference of brightness, but, if speed is a very important reference quantity, then the mean absolute error evaluation function is a reasonable selection.
Usually, the time that calculating mean absolute error (MAE) is spent is a lot, therefore, in the present invention, proposes a kind of tailoring technique (pruning technique), is used for quickening the calculating of MAE.At first utilize a matrix (matrix) to be recorded in the temporary transient value of accumulation MAE when calculating previous MAE, regard threshold value with this matrix.If present MAE value, then there is no need further accumulation less than its pairing threshold value (being present in the matrix) and calculates the MAE value.Adopt this tailoring technique, just can avoid many unnecessary correlation calculations, therefore obviously improved the efficient of coupling, also can calculate optimum solution soon.
In case find after the optimum solution, just can two adjacent images be joined together.Two adjacent images have the inconsistent situation of brightness, therefore, must utilize so-called hybrid technology (blendingtechnique) to eliminate the inconsistent problem of brightness.With reference to Fig. 5, suppose P iFor in image I aOn a bit, q iBe p iAt I bOn corresponding point, l aAnd l bBe I aAnd I bIndivedual edge lines, d aBe p iTo l aDistance, d bBe q iTo l bDistance, if r iBe p iAnd q iCorresponding point on composograph I are then utilized p iAnd q i, can utilize following formula to obtain r iBrightness: I ( r i ) = d a ′ I a ( p i ) + d b ′ I b ( q i ) d a ′ + d b ′ , - - - ( 7 ) Wherein t represents index, and it is an adjustable parameter.Utilize formula (7), just can get synthetic to the end image.
Fig. 6 is a hardware configuration of the present invention, utilizes this structure to be connected together the image of input in real time.Input equipment 32 can be digital camera or scanner, can obtain a series of image by input equipment.These images can be stored in External memory equipment 32 as hard disk or directly deliver on the random access memory of microprocessor (RAM), and microprocessor comprises warp image (warping images), rim detection (edgedetection), produces possible separating functions such as (hypothesis generation).The data that temporarily obtain can be put on the RAM of microprocessor, to improve the speed of map interlinking.In case the work of map interlinking is finished, just can directly be shown to these results on the screen, these functions can be finished with general personal computer.
More than illustrated in and the explanation be a preferred embodiment of the present invention.Scope that is covered according to the present invention and spirit, the present invention can also do multiple variation.

Claims (17)

1. method that one first image and one second image graphics are bonded together, this method comprises the steps: at least
First image and second scalloping to one are represented the mathematical model of panorama ring field image;
Detect one first horizontal or vertical limit of first image that twisted, and one second horizontal or vertical limit of second image of corresponding distortion;
From these first and second limits that detect record their data and position coordinates;
Find out one group of possible homographic solution from the data and the position coordinates on these first and second limits; And
Utilize these possible homographic solutions to determine the abutment homographic solution an of the best, so that two images are joined together.
2. image picture connecting method as claimed in claim 1, wherein mathematical model is made of a plurality of pixel of representing the panorama ring field image, and described method utilizes following formula to carry out brightness calculation after connecing at the abutment of determining the best and two images: I ( r i ) = d a ′ I a ( P i ) + d b ′ I b ( q i ) d a ′ + d b ′
Wherein t represents the index of an adjustable parameter, the step that first image that twisted and second image that twist are mixed, thus make the pixel intensity acquisition of two image bonding parts seamlessly transit.
3. image picture connecting method as claimed in claim 1 or 2, the step of data that wherein detects first and second limits of each first and second image that twisted respectively comprises at least:
Detect a vertical edges of each described first and second images, wherein also comprise following steps:
For each first and second image, along the Grad of each each pixel of column count;
Grad along each each pixel of row accumulation; And
A described accumulated value and a prior predetermined threshold value are compared.
4. image picture connecting method as claimed in claim 1 or 2, the step of data that wherein detects first and second limits of each first and second image that twisted respectively comprises at least:
Detect the horizontal sides of each described first and second images, wherein comprise following steps:
For each first image and second image, calculate the Grad of each pixel along each row;
Grad along each each pixel of row accumulation; And
A described accumulated value and a prior predetermined threshold value are compared.
5. image picture connecting method as claimed in claim 1 or 2, the step of wherein finding out one group of possible homographic solution comprises following steps:
According to following formula displacement calculating function: d ( i , k ) = min 1 ≤ j ≤ N b | P a ( i ) - k - P b ( j ) | , Wherein: P a(i) be illustrated in the position of i bar vertical edges in first image that twisted;
P b(j) be illustrated in the position of j bar vertical edges in second image that twisted;
N bBe illustrated in the number of vertical edges in second image that twisted;
K is a variable of user's definition;
Calculating is at P a(i, k) value is less than a prior predetermined threshold value T for its displacement function d in this set 0Element number, suppose total N pIndividual element satisfies this condition;
To the described N that satisfies condition pIndividual element calculates their d (i, mean value k);
According to described mean value and N pCheck a position k, determine if it is a possible homographic solution, if a position k is a possible homographic solution, then it must satisfy following condition:
Mean value must be less than the second prior predetermined threshold value T 1, and N pMust be greater than the 3rd prior predetermined threshold value T 2
6. image picture connecting method as claimed in claim 3, the step of wherein finding out one group of possible homographic solution comprises following steps:
According to following formula displacement calculating function: d ( i , k ) = min 1 ≤ j ≤ N b | P a ( i ) - k - P b ( j ) | , Wherein: P a(i) be illustrated in the position of i bar vertical edges in first image that twisted;
P b(j) be illustrated in the position of twisting j bar vertical edges in second image later;
N bBe illustrated in the number of vertical edges in second image that twisted;
K is a variable of user's definition;
Calculating is at P a(i, k) value is less than a prior predetermined threshold value T for its displacement function d in this set 0Element number, suppose total N pIndividual element satisfies this condition;
For the described N that satisfies condition pIndividual element calculates their d (i, mean value k);
According to described mean value and N p, determining the position k of a possible homographic solution, described position k satisfies following condition:
Mean value must be less than one second prior predetermined threshold value T 1, and N pMust be greater than one the 3rd prior predetermined threshold value T 2
7. image picture connecting method as claimed in claim 4, the step of wherein finding out one group of possible homographic solution comprises following steps:
According to following formula displacement calculating function: d ( i , k ) = min 1 ≤ j ≤ N b | P a ( i ) - k - P b ( j ) | , Wherein: P a(i) be illustrated in the position of i bar horizontal sides in first image that twisted;
P b(j) be illustrated in the position of j bar horizontal sides in second image that twisted;
N bBe illustrated in the number of horizontal sides in second image that twisted;
K is a variable of user's definition;
Calculating is at P a(i, k) value is less than a prior predetermined threshold value T for its displacement function d in this set 0Element number, suppose total N pIndividual element satisfies this condition;
For the described N that satisfies condition pIndividual element calculates their d (i, mean value k);
According to described mean value and N p, determining the position k of a possible homographic solution, described position k satisfies following condition:
Mean value must be less than the second prior predetermined threshold value T 1, and N pMust be greater than one the 3rd prior predetermined threshold value T 2
8. image picture connecting method as claimed in claim 1 or 2 is wherein determined optimum solution with the technology of mean absolute error relevant matches from possible separating.
9. image picture connecting method as claimed in claim 6 is wherein determined optimum solution with the technology of mean absolute error relevant matches from possible separating.
10. image picture connecting method as claimed in claim 7 is wherein determined optimum solution with the technology of mean absolute error relevant matches from possible separating.
11. image picture connecting method as claimed in claim 1 or 2 wherein determines optimum solution with the technology of canonical simple crosscorrelation coupling from possible separating.
12. image picture connecting method as claimed in claim 6 is wherein determined optimum solution with the technology of canonical simple crosscorrelation coupling from possible separating.
13. image picture connecting method as claimed in claim 7 wherein determines optimum solution with the technology of canonical simple crosscorrelation coupling from possible separating.
14. an image image connecting system, one first image and one second image that are used for the mathematical model of the representative panorama ring field image that will be made of a plurality of pixels are bonded together, and described system comprises at least:
One edge detecting device, be used to detect one first horizontal or vertical limit of first image that twisted and corresponding distortion one second horizontal or vertical limit of second image, and write down the position on described detected limit, thereby obtain the set of relevant limit position data;
One storer, the set that is used for writing down the position data that detects vertical edges or horizontal sides;
One feasible solution generator is used for producing one group of possible homographic solution from the position data of first and second vertical edges or horizontal sides; And
One optimum solution selector switch is used for determining an optimum solution from the set of described one group of feasible solution.
15. image image connecting system as claimed in claim 14, wherein said storer also is used for storing the pixel of representing first and second images that twisted, described system also comprises one and mixes engine, it utilizes the data in the storer that first and second images that twisted are bonded into a big ring field image, and described mixing engine is to utilize following formula to carry out brightness calculation: I ( r i ) = d a ′ I a ( P i ) + d b ′ I b ( q i ) d a ′ + d b ′
Wherein t represents the index of an adjustable parameter, the step that first image that twisted and second image that twist are mixed, thus make the pixel intensity acquisition of two image bonding parts seamlessly transit.
16. image image connecting system as claimed in claim 15 wherein also comprises a microprocessor, described microprocessor comprises:
Described edge detector, described generator, described optimum solution selector switch and the described mixing engine separated.
17. image image connecting system as claimed in claim 14, wherein said system also comprises an external memory storage, is used to store the image that all twisted.
CN 98103910 1998-01-09 1998-01-09 Image connecting system and method for ring field image type virtual environment Expired - Fee Related CN1090357C (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN 98103910 CN1090357C (en) 1998-01-09 1998-01-09 Image connecting system and method for ring field image type virtual environment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN 98103910 CN1090357C (en) 1998-01-09 1998-01-09 Image connecting system and method for ring field image type virtual environment

Publications (2)

Publication Number Publication Date
CN1222711A CN1222711A (en) 1999-07-14
CN1090357C true CN1090357C (en) 2002-09-04

Family

ID=5218092

Family Applications (1)

Application Number Title Priority Date Filing Date
CN 98103910 Expired - Fee Related CN1090357C (en) 1998-01-09 1998-01-09 Image connecting system and method for ring field image type virtual environment

Country Status (1)

Country Link
CN (1) CN1090357C (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1297946C (en) * 2003-10-15 2007-01-31 财团法人工业技术研究院 Method for constructing three-dimensional regularized color model

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101015199B (en) * 2004-07-07 2011-10-19 日本电气株式会社 Wide field-of-view image input method and device
CN101394571B (en) * 2007-09-21 2012-02-08 台湾新力国际股份有限公司 Fast dynamic image joint point searching method
GB2473247B (en) * 2009-09-04 2015-02-11 Sony Corp A method and apparatus for image alignment

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1297946C (en) * 2003-10-15 2007-01-31 财团法人工业技术研究院 Method for constructing three-dimensional regularized color model

Also Published As

Publication number Publication date
CN1222711A (en) 1999-07-14

Similar Documents

Publication Publication Date Title
US6011558A (en) Intelligent stitcher for panoramic image-based virtual worlds
CN100591100C (en) Image processing apparatus, image processing method and computer program
CN103358993B (en) A system and method for recognizing a parking space line marking for a vehicle
Du et al. Interactive 3D modeling of indoor environments with a consumer depth camera
CN111462503B (en) Vehicle speed measuring method and device and computer readable storage medium
Tuytelaars et al. The cascaded Hough transform as an aid in aerial image interpretation
US8548227B2 (en) Image processing apparatus and computer program
TWI548276B (en) Method and computer-readable media for visualizing video within existing still images
CN101394573B (en) Panoramagram generation method and system based on characteristic matching
CN108495089A (en) vehicle monitoring method, device, system and computer readable storage medium
CN102859535A (en) Daisy descriptor generation from precomputed scale-space
US5912670A (en) Method and apparatus for overlaying a bit map image on an environment map
CN106447608B (en) A kind of video image joining method and device
CN102903101B (en) Method for carrying out water-surface data acquisition and reconstruction by using multiple cameras
US8687000B2 (en) Image generating apparatus and computer program
Lin et al. CRPN-SFNet: A high-performance object detector on large-scale remote sensing images
CN116883610A (en) Digital twin intersection construction method and system based on vehicle identification and track mapping
Lin et al. Topological map construction and scene recognition for vehicle localization
CN1090357C (en) Image connecting system and method for ring field image type virtual environment
CN102081796A (en) Image splicing method and device thereof
Zhu et al. Large-scale architectural asset extraction from panoramic imagery
JP2001101419A (en) Method and device for image feature tracking processing and three-dimensional data preparing method
CN113901961B (en) Parking space detection method, device, equipment and storage medium
US9033517B2 (en) Image processing method, and recording medium storing image processing control program
CN113297344B (en) Three-dimensional remote sensing image-based ground linear matching method and device and ground object target position positioning method

Legal Events

Date Code Title Description
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C06 Publication
PB01 Publication
C14 Grant of patent or utility model
GR01 Patent grant
ASS Succession or assignment of patent right

Owner name: YUDONG TECHNOLOGY CO., LTD.

Free format text: FORMER OWNER: INDUSTRIAL TECHNOLOGY RESEARCH INSTITUTE

Effective date: 20070126

C41 Transfer of patent application or patent right or utility model
TR01 Transfer of patent right

Effective date of registration: 20070126

Address after: Taiwan province of China

Patentee after: Transpacific IP Pte Ltd.

Address before: Hsinchu County of Taiwan Province

Patentee before: Industrial Technology Research Institute

C17 Cessation of patent right
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20020904

Termination date: 20110109