CN101339604A - Novel mark point graph and its recognition, tracking and positioning algorithm based on visual sense constantmagnitude - Google Patents
Novel mark point graph and its recognition, tracking and positioning algorithm based on visual sense constantmagnitude Download PDFInfo
- Publication number
- CN101339604A CN101339604A CNA2008101163763A CN200810116376A CN101339604A CN 101339604 A CN101339604 A CN 101339604A CN A2008101163763 A CNA2008101163763 A CN A2008101163763A CN 200810116376 A CN200810116376 A CN 200810116376A CN 101339604 A CN101339604 A CN 101339604A
- Authority
- CN
- China
- Prior art keywords
- pentagon
- monumented point
- pentagonal
- novel
- point
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 230000000007 visual effect Effects 0.000 title description 2
- 238000004364 calculation method Methods 0.000 claims abstract description 5
- 230000003190 augmentative effect Effects 0.000 claims description 9
- 239000003550 marker Substances 0.000 claims description 9
- 238000001514 detection method Methods 0.000 claims description 8
- 238000000034 method Methods 0.000 claims description 8
- 238000000605 extraction Methods 0.000 claims description 7
- 230000004927 fusion Effects 0.000 claims description 3
- 238000013461 design Methods 0.000 abstract description 10
- 230000007613 environmental effect Effects 0.000 abstract description 2
- 238000005516 engineering process Methods 0.000 description 6
- 239000011159 matrix material Substances 0.000 description 4
- 230000009286 beneficial effect Effects 0.000 description 2
- 238000013519 translation Methods 0.000 description 2
- 108091026890 Coding region Proteins 0.000 description 1
- 230000003044 adaptive effect Effects 0.000 description 1
- 230000002708 enhancing effect Effects 0.000 description 1
- 238000005286 illumination Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012545 processing Methods 0.000 description 1
Images
Landscapes
- Image Analysis (AREA)
Abstract
The invention relates to a novel marked point pattern based on vision invariants and identification and tracking positioning algorithm thereof. The invention comprises a design of novel marked point pattern based on vision invariants and identification and tracking positioning algorithm based on the novel marked point. The novel marked point pattern based on vision invariants is a black pentagon with a round mark. The marked point can be a convex pentagon or a concave pentagon. The round mark is used for identifying a first vertex of the pentagon. The pattern is coded using the cross-ratio invariant of the pentagon and combining the concavity and convexity of the vertex. The marked point pattern based on vision invariants can conduct attitude calculation using self-characteristics and realize the coding of the marked point, thus saving the area needed by coding patterns, reducing the pattern size of the marked point and improving the registration precision in unit area. The tracking registration algorithm can be used for identifying the marked point, tracking the head posture of the user and calculating the accurate position and posture of virtual scenes in true environmental space.
Description
Technical field
The present invention relates to a kind of monumented point design, especially relate to a kind of augmented reality of this distinctive mark point that utilizes and follow the tracks of registration algorithm, belong to the virtual reality field based on the vision invariant.
Background technology
Based on artificial target's tracking registration technology is the most ripe and practical application registration technology the most widely in the current augmented reality system.So-called " monumented point " is meant the special graph pattern of being printed by artificial design.Because the singularity of its pictorial pattern, be difficult to various scenes in environmental background similar, therefore be convenient to from environment, distinguish.Monumented point can obtain the corresponding point set of its 3 d space coordinate and its projected image through the identification location algorithm, calculates the six degree of freedom attitude information of video camera with respect to real scene by the attitude algorithm for estimating.
Important achievement has all been made aspect the registration technology following the tracks of based on the artificial target in external many laboratories.HTL lab design as Washington, DC university has been developed the ARToolKit software package.The square monumented point that uses in this software package is the most frequent adopted monumented point pattern in the current AR system.Because the ARToolKit processing procedure adopts bianry image, ratio of precision is lower, owing to adopted the figure relevant matches aspect codes match, matching efficiency and group/cording quantity all are restricted simultaneously.Japan's Sony computer laboratory was delivered a kind of and monumented point system like the ARToolKit comparing class in 1998, and its encryption algorithm has been carried out certain improvement, made it can design coding more easily.Graduate X.Zhang of Siemens and N.Navab have carried out important improvement to the monumented point system of ARToolKit pattern, have significantly improved its tracking accuracy.The algorithm of this monumented point system has very outstanding character, and is very big for the AR registration technology contribution based on sign.And the people such as Charles B. of U.S. Michigan State University have provided the graphical design method that can obtain maximum group/cording quantity in theory after having analyzed inner pattern coding method.After this, M.Fiala delivered the ARTag monumented point and has followed the tracks of Accreditation System in 2005.All there is very important contribution in this monumented point system for identification, feature location and the two-dimensional bar coding and decoding algorithm of monumented point registration.Except the above square monumented point that is similar to the ARToolKit pattern, also there are some circular monumented point systems to publish at present.Circle marker dot system and Diego L ó pez de that the people such as Leonid Naimark of the wherein more representational InterSense of being company delivered in 2002
Deng the TRIP system that delivered in 2002.
Yet in these monumented point systems, the monumented point design of patterns often is divided into two independent parts, and a part is specifically designed to the coding of contour pattern, and another part is used for the extraction and the Attitude Calculation of unique point.The result of Fen Liing causes the monumented point pattern to need large-area coding region like this, does not utilize the size that reduces the monumented point figure, improves the available precision of unit area.In following the tracks of registration process, need coding is decoded simultaneously, increased the computation burden of computing machine.
Summary of the invention
In order to overcome existing shortcoming of following the tracks of the registration technology aspect based on the augmented reality of monumented point, system of the present invention comprises a kind of novel monumented point figure and identification, Tracking and Orientation Arithmetic based on the vision invariant, can be applicable to augmented reality and follows the tracks of in the Accreditation System.Beneficial effect of the present invention is, novel monumented point based on the vision invariant has made full use of the vision invariant information that the monumented point figure self is had, save the required area of coding pattern, closely reduced the bulk of monumented point figure, improved the available precision of unit area.Accreditation System is followed the tracks of in enhancing based on this vision invariant monumented point, has higher robustness to changing with great visual angle.
The present invention propose a kind of adopt pentagon that black has white circular mark as a token of the augmented reality of dot pattern follow the tracks of Accreditation System.Pentagonal summit is as carrying out the matching characteristic that attitude is estimated; Select to constitute simultaneously this pentagonal five limits calculate its double ratio projective invariant with and concavity and convexity, in order to encode and the distinguishing mark point.For solving the problem that unique point is mated in proper order, in the pentagon figure, add circular mark, be used to discern pentagonal first summit.Discern pentagonal first summit, just determined the order direction on its summit, thereby can determine the matching relationship of unique point.With reference to Fig. 1, be a pentagon that has black or white circle marker based on the novel monumented point figure of vision invariant, the position on this each summit of pentagon can be selected arbitrarily as required as long as guarantee not conllinear of any three summits.And this novel monumented point does not limit pentagonal concavo-convex characteristic, and promptly pentagon can be that protruding pentagon also can be recessed pentagon.Circle marker is used for determining pentagonal first summit.If pentagon be protruding pentagon then circle marker be that white is positioned at pentagon inside, if pentagon be recessed pentagon then circle marker be that black is positioned at the pentagon outside.Determine pentagonal summit order, just can determine the matching relationship of unique point.Utilize pentagonal five limits to calculate its double ratio invariant (I
1, I
2) and in conjunction with the concavity and convexity on summit figure is encoded.
M wherein
Ijk=(l
i, l
j, l
k), (l=(l
1, l
2, l
3) l represents straight-line equation: l
1X+l
2Y+l
3=0), | M| is a determinant of a matrix.
Fig. 2 is the design of circular mark placement location in the monumented point.In order to solve the problem that unique point is mated in proper order, in pentagon, added a circular mark, be used to discern pentagonal first summit.Discern pentagonal first summit, just determined the order (other summit is chosen along clockwise direction) on each summit on it, thereby can determine the matching relationship of unique point.The home position of circular mark is positioned at (x
0, y
0).Wherein:
(x
1, y
1) be the coordinate on first summit of pentagon, (x
c, y
c) two the leg-of-mutton barycentric coordinates that summit constituted adjacent with first summit of pentagon of serving as reasons.
Designed identification, the Tracking and Orientation Arithmetic flow process based on the novel monumented point of vision invariant of the present invention is as follows:
(1) all black regions in the extraction institute images acquired;
(2) connected region of the black region that arrives of Detection and Extraction;
(3) pentagon detects;
(4) extract the pentagon edge;
(5) edge thinning obtains single pixel wide edge;
(6) the fitting a straight line algorithm obtains the straight line parameter;
(7) the circular mark in the detection monumented point figure obtains the series arrangement on its summit;
(8) all candidate's pentagonal regions are carried out error-detecting.If the error-detecting result less than preset threshold, will be identified as correct monumented point figure; If then do not withdraw from;
(9) detect pentagonal concavo-convex characteristic;
(10) calculate double ratio invariant by pentagonal limit constituted;
(11) utilize the monumented point characteristic information in convex and concave feature vector and double ratio invariant and the database to compare, determine the coding of monumented point;
(12) repeat (9)-(11) step, all monumented point in detecting present image;
(13) adopt augmented reality registration algorithm to carry out Attitude Calculation based on plane characteristic point;
(14) realize the fusion of true and virtual scene.
According to foregoing description of the present invention, it is big that the present invention can effectively solve certain monumented point figure area occupied, the shortcoming that coding is complicated, and the feature that makes full use of figure self realizes following the tracks of registration based on the augmented reality of this novel monumented point.
Description of drawings
Fig. 1 is the monumented point graphic designs based on the vision invariant among the present invention; The recessed pentagon monumented point of Fig. 1 a.-, the protruding pentagon monumented point of Fig. 1 b.-;
Fig. 2 is the design of circular mark in the monumented point.
Embodiment
Below in conjunction with concrete embodiment the present invention is described in further details.At this, illustrative examples of the present invention and explanation thereof are used to explain the present invention, but not as a limitation of the invention.
In real scene, place the designed pentagon monumented point of the present invention, utilize video camera to take the image information that this scene is obtained scene.The concrete implementing procedure of identification, Tracking and Orientation Arithmetic is as follows:
(1) all black regions in the extraction institute images acquired, this place does not limit and adopts which kind of image binaryzation algorithm;
Adopt the watershed divide adaptive thresholding algorithm to carry out black region in the present embodiment and extract, to guarantee the adaptivity of algorithm illumination variation.
(2) connected region of the black region that arrives of Detection and Extraction, this place does not limit and adopts which kind of connected region detection algorithm;
Adopt label connected region detection algorithm in the present embodiment.
(3) utilize the pentagon detection algorithm to detect pentagon, and extract the pentagon edge, it is refine to single pixel wide;
(4) then adopt the fitting a straight line algorithm to obtain the straight line parameter, this place does not limit and adopts which kind of fitting a straight line algorithm;
Adopted least square method to carry out fitting a straight line in the present embodiment.
(5) utilize white or black circle in the figure to determine pentagonal first summit, and choose other summits on the pentagon in the direction of the clock;
(6) the homography error-detecting is carried out in all candidate regions of choosing.If the error-detecting result less than preset threshold, with being identified as correct match flag point, does not detect then and withdraws from;
(7) detect the concavo-convex characteristic on each summit of monumented point successively, and constitute convex and concave feature vector (a
1, a
2, a
3, a
4, a
5), if the concave crown point is expressed as " 1 ", concave vertex is expressed as " 0 ".As the recessed pentagon monumented point of Fig. 1 a pattern, its convex and concave feature vector is (1,0,0,0,0).
(8) calculate double ratio invariant (I by pentagonal limit constituted
1, I
2); Utilize double ratio invariant and concavo-convex vector as eigenvector, adopt the monumented point information in mahalanobis distance and the database to compare, as if the monumented point that identifies that praises less than the preset threshold system; If then all monumented points in detecting present image are detected in other candidate region greater than threshold value;
(9) adopt augmented reality registration algorithm to carry out Attitude Calculation, calculate rotation matrix R and the translation matrix T of video camera with respect to the monumented point world coordinate system based on plane characteristic point.
(10) will rotate and translation matrix value assignment is given virtual video camera, and make it, finish virtual and fusion real scene along this orbiting motion.
Above-described specific descriptions; purpose, technical scheme and beneficial effect to invention further describe; institute is understood that; the above only is specific embodiments of the invention; and be not intended to limit the scope of the invention; within the spirit and principles in the present invention all, any modification of being made, be equal to replacement, improvement etc., all should be included within protection scope of the present invention.
Claims (1)
1. one kind based on the novel monumented point figure of vision invariant and identification thereof, Tracking and Orientation Arithmetic, it is characterized in that, novel monumented point figure based on the vision invariant is a pentagon that has black or white circle marker, and the position on this each summit of pentagon can be selected arbitrarily as required as long as guarantee not conllinear of any three summits; And this novel monumented point does not limit pentagonal concavo-convex characteristic, and promptly pentagon can be that protruding pentagon also can be recessed pentagon; Wherein circle marker is used for determining pentagonal first summit; If pentagon be protruding pentagon then circle marker be that white is positioned at pentagon inside, if pentagon be recessed pentagon then circle marker be that black is positioned at the pentagon outside; Determine pentagonal summit order, just can determine the matching relationship of unique point; Utilize pentagonal five limits to calculate its double ratio invariant (I
1, I
2) and in conjunction with the concavity and convexity on summit figure is encoded; Identification, Tracking and Orientation Arithmetic flow process based on the novel monumented point of vision invariant are as follows:
(1) all black regions in the extraction institute images acquired;
(2) connected region of the black region that arrives of Detection and Extraction;
(3) pentagon detects;
(4) extract the pentagon edge;
(5) edge thinning obtains single pixel wide edge;
(6) the fitting a straight line algorithm obtains the straight line parameter;
(7) the circular mark in the detection monumented point figure obtains the series arrangement on its summit;
(8) all candidate's pentagonal regions are carried out error-detecting, if the error-detecting result less than preset threshold, will be identified as correct monumented point figure; If then do not withdraw from;
(9) detect pentagonal concavo-convex characteristic;
(10) calculate double ratio invariant by pentagonal limit constituted;
(11) utilize the monumented point characteristic information in convex and concave feature vector and double ratio invariant and the database to compare, determine the coding of monumented point;
(12) repeat (9)-(11) step, all monumented point in detecting present image;
(13) adopt augmented reality registration algorithm to carry out Attitude Calculation based on plane characteristic point;
(14) realize the fusion of true and virtual scene.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2008101163763A CN101339604B (en) | 2008-07-09 | 2008-07-09 | Novel mark point graph and its recognition, tracking and positioning algorithm based on visual sense invariance |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2008101163763A CN101339604B (en) | 2008-07-09 | 2008-07-09 | Novel mark point graph and its recognition, tracking and positioning algorithm based on visual sense invariance |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN101339604A true CN101339604A (en) | 2009-01-07 |
| CN101339604B CN101339604B (en) | 2010-07-28 |
Family
ID=40213670
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN2008101163763A Expired - Fee Related CN101339604B (en) | 2008-07-09 | 2008-07-09 | Novel mark point graph and its recognition, tracking and positioning algorithm based on visual sense invariance |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN101339604B (en) |
Cited By (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101853396A (en) * | 2010-06-17 | 2010-10-06 | 中国人民解放军信息工程大学 | Identification method of point-distributed coded marks |
| CN102376078A (en) * | 2010-08-25 | 2012-03-14 | 北京中科亚创科技有限责任公司 | Method and device for sorting automatic marks for scenes |
| CN104732477A (en) * | 2015-02-04 | 2015-06-24 | 长春理工大学 | Register tracking method based on electromagnetic position tracker and motion capture system |
| CN104866859A (en) * | 2015-05-29 | 2015-08-26 | 南京信息工程大学 | High-robustness visual graphical sign and identification method thereof |
| CN106500699A (en) * | 2016-05-25 | 2017-03-15 | 上海铸天智能科技有限公司 | A kind of position and orientation estimation method suitable for Autonomous landing in unmanned plane room |
| CN108717709A (en) * | 2018-05-24 | 2018-10-30 | 东北大学 | Image processing system and image processing method |
| CN112614188A (en) * | 2020-12-07 | 2021-04-06 | 上海交通大学 | Dot-matrix calibration board based on cross ratio invariance and identification method thereof |
| CN113894799A (en) * | 2021-12-08 | 2022-01-07 | 北京云迹科技有限公司 | Robot and marker identification method and device for assisting environment positioning |
| CN117172796A (en) * | 2023-08-07 | 2023-12-05 | 北京智慧大王科技有限公司 | Big data electronic commerce management system |
-
2008
- 2008-07-09 CN CN2008101163763A patent/CN101339604B/en not_active Expired - Fee Related
Cited By (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101853396A (en) * | 2010-06-17 | 2010-10-06 | 中国人民解放军信息工程大学 | Identification method of point-distributed coded marks |
| CN101853396B (en) * | 2010-06-17 | 2012-12-05 | 中国人民解放军信息工程大学 | Identification method of point-distributed coded marks |
| CN102376078A (en) * | 2010-08-25 | 2012-03-14 | 北京中科亚创科技有限责任公司 | Method and device for sorting automatic marks for scenes |
| CN104732477B (en) * | 2015-02-04 | 2018-03-16 | 长春理工大学 | Registration method based on Magnetic position tracker and motion capture system |
| CN104732477A (en) * | 2015-02-04 | 2015-06-24 | 长春理工大学 | Register tracking method based on electromagnetic position tracker and motion capture system |
| CN104866859A (en) * | 2015-05-29 | 2015-08-26 | 南京信息工程大学 | High-robustness visual graphical sign and identification method thereof |
| CN104866859B (en) * | 2015-05-29 | 2018-08-21 | 南京信息工程大学 | A kind of visual pattern mark of high robust and its recognition methods |
| CN106500699A (en) * | 2016-05-25 | 2017-03-15 | 上海铸天智能科技有限公司 | A kind of position and orientation estimation method suitable for Autonomous landing in unmanned plane room |
| CN106500699B (en) * | 2016-05-25 | 2019-06-18 | 上海铸天智能科技有限公司 | A kind of position and orientation estimation method suitable for Autonomous landing in unmanned plane room |
| CN108717709A (en) * | 2018-05-24 | 2018-10-30 | 东北大学 | Image processing system and image processing method |
| CN108717709B (en) * | 2018-05-24 | 2022-01-28 | 东北大学 | Image processing system and image processing method |
| CN112614188A (en) * | 2020-12-07 | 2021-04-06 | 上海交通大学 | Dot-matrix calibration board based on cross ratio invariance and identification method thereof |
| CN113894799A (en) * | 2021-12-08 | 2022-01-07 | 北京云迹科技有限公司 | Robot and marker identification method and device for assisting environment positioning |
| CN117172796A (en) * | 2023-08-07 | 2023-12-05 | 北京智慧大王科技有限公司 | Big data electronic commerce management system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN101339604B (en) | 2010-07-28 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN101339604B (en) | Novel mark point graph and its recognition, tracking and positioning algorithm based on visual sense invariance | |
| Uchiyama et al. | Random dot markers | |
| Yu et al. | TopoTag: A robust and scalable topological fiducial marker system | |
| TWI419081B (en) | Method and system for providing augmented reality based on marker tracing, and computer program product thereof | |
| US9111135B2 (en) | Systems and methods for tracking human hands using parts based template matching using corresponding pixels in bounded regions of a sequence of frames that are a specified distance interval from a reference camera | |
| US8934675B2 (en) | Systems and methods for tracking human hands by performing parts based template matching using images from multiple viewpoints | |
| Romero-Ramire et al. | Fractal markers: A new approach for long-range marker pose estimation under occlusion | |
| US9177239B1 (en) | Generating machine-readable optical codes with aesthetic component | |
| Azad et al. | Stereo-based 6d object localization for grasping with humanoid robot systems | |
| Köhler et al. | Detection and identification techniques for markers used in computer vision | |
| US20130236089A1 (en) | Learning-based estimation of hand and finger pose | |
| CN105894069B (en) | A kind of generation method and recognition methods of the CRC two dimensional code of vision guided navigation | |
| US10043279B1 (en) | Robust detection and classification of body parts in a depth map | |
| Zhang et al. | DeepTag: a general framework for fiducial marker design and detection | |
| Peng et al. | PVNet: Pixel-wise voting network for 6DoF object pose estimation | |
| Zhou et al. | Vision-based pose estimation from points with unknown correspondences | |
| CN114240981A (en) | Mark identification method and device | |
| Basiratzadeh et al. | Fiducial marker approach for biomechanical smartphone-based measurements | |
| CN108694348B (en) | Tracking registration method and device based on natural features | |
| JP6011885B2 (en) | Code reading apparatus and code reading method | |
| Li et al. | A novel marker system in augmented reality | |
| Yoon et al. | Increasing camera pose estimation accuracy using multiple markers | |
| Han et al. | L-split marker for augmented reality in aircraft assembly | |
| Álvarez et al. | A new marker design for a robust marker tracking system against occlusions | |
| Bradley et al. | Natural interaction with virtual objects using vision-based six dof sphere tracking |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20100728 |
|
| CF01 | Termination of patent right due to non-payment of annual fee |