CN106249881A - Augmented reality view field space and virtual three-dimensional target dynamic method for registering - Google Patents

Augmented reality view field space and virtual three-dimensional target dynamic method for registering Download PDF

Info

Publication number
CN106249881A
CN106249881A CN201610582291.9A CN201610582291A CN106249881A CN 106249881 A CN106249881 A CN 106249881A CN 201610582291 A CN201610582291 A CN 201610582291A CN 106249881 A CN106249881 A CN 106249881A
Authority
CN
China
Prior art keywords
augmented reality
view field
virtual
registering
connected domain
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201610582291.9A
Other languages
Chinese (zh)
Other versions
CN106249881B (en
Inventor
王立军
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Jiangsu Augurit As Special Mdt Infotech Ltd
Original Assignee
Jiangsu Augurit As Special Mdt Infotech Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Jiangsu Augurit As Special Mdt Infotech Ltd filed Critical Jiangsu Augurit As Special Mdt Infotech Ltd
Priority to CN201610582291.9A priority Critical patent/CN106249881B/en
Publication of CN106249881A publication Critical patent/CN106249881A/en
Application granted granted Critical
Publication of CN106249881B publication Critical patent/CN106249881B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00Manipulating 3D models or images for computer graphics
    • G06T19/006Mixed reality
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2203/00Indexing scheme relating to G06F3/00 - G06F3/048
    • G06F2203/01Indexing scheme relating to G06F3/01
    • G06F2203/012Walk-in-place systems for allowing a user to walk in a virtual environment while constraining him to a given position in the physical environment

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Computer Graphics (AREA)
  • Computer Hardware Design (AREA)
  • Software Systems (AREA)
  • Processing Or Creating Images (AREA)

Abstract

The invention discloses a kind of augmented reality view field space and virtual three-dimensional target dynamic method for registering, comprise the following steps: obtain real scene information and camera location information;First the dummy object coordinate affine transformation to camera view plane is calculated according to the telltale mark in the positional information of camera and real scene by picture system, on view plane, dummy object is drawn according to affine transformation matrix, shown by optical perspective Helmet Mounted Display, obtain augmented reality system diagram picture;Image being carried out binarization segmentation, judges which partly belongs to environmental background according to the gamma characteristic of image after segmentation, which partly belongs to mark;Bianry image is done connected domain analysis, and the black-pixel region that search area is bigger in the picture determines mark view field;Mark view field extracts the point that Curvature varying is bigger, thus defines the shape of connected domain;The shape of connected domain is mapped with threedimensional model by picture system, draws the correct threedimensional model of marker.

Description

Augmented reality view field space and virtual three-dimensional target dynamic method for registering
Technical field
The present invention relates to image processing field, particularly relate to a kind of augmented reality view field space and virtual three-dimensional target dynamic Method for registering.
Background technology
In augmented reality system, the true environment that registration is primarily referred to as around dummy object and user that computer produces is complete Alignment of orientation.Requiring that user maintains correct registration relation in the motor process of true environment, bigger registration error is not only Make user can not confirm dummy object existence in true environment and integraty from sense organ, even can change user to week The sensation in collarette border, serious registration error results even in full of prunes behavior.
Because above-mentioned defect, the design people, the most in addition research and innovation, empty to founding a kind of augmented reality visual field Between and virtual three-dimensional target dynamic method for registering so that it is have more the value in industry.
Summary of the invention
For solving above-mentioned technical problem, it is an object of the invention to provide and a kind of ensure that correct registration relation, improve The augmented reality view field space of registration accuracy and virtual three-dimensional target dynamic method for registering.
A kind of augmented reality view field space of present invention proposition and virtual three-dimensional target dynamic method for registering, its feature exists In: comprise the following steps:
Step (1): obtain real scene information and camera location information;
Step (2): first counted according to the telltale mark in the positional information of camera and real scene by picture system Calculate the dummy object coordinate affine transformation to camera view plane, then according to affine transformation matrix draws virtual object on view plane Body, is finally directly shown by optical perspective Helmet Mounted Display, obtains augmented reality system diagram picture;
Step (3): the image showing optical perspective Helmet Mounted Display carries out binarization segmentation, according to image after segmentation Gamma characteristic judges that in augmented reality system diagram picture, which partly belongs to environmental background, and which partly belongs to mark;
Step (4): bianry image is done connected domain analysis, by the black picture element that search area in bianry image is bigger Region determines mark view field;
Step (5): the point that extraction Curvature varying is bigger in mark view field, thus the shape of explication connected domain Shape;
Step (6): the shape of connected domain be mapped with threedimensional model in picture system, draws matching result, root The correct threedimensional model of marker is drawn according to matching result.
Further, the mode obtaining real scene information and camera location information described in step (1) is by adopting Light source and the image with geometric distribution is received, then by calculating acquisition information with camera head and light-sensitive device.
Further, calculating dummy object coordinate described in step (2) to the mode of the affine transformation of camera view plane is The dummy object in real scene is selected by the three-dimensional coordinate position of spatial point.
Further, the binarization segmentation mode described in step (3) is to use histogram thresholding split-run.
Further, the connected domain analysis described in step (4) comprises the following steps:
Step (4.1): searching for black picture element from whole bianry image, search is from the beginning of the upper left corner of image, with line order It is as the criterion and carries out successively;
Step (4.2): for a black picture element detected, be set to scan by its flag bit, and build with this Territory is faced in the search of individual 3*3 big centered by pixel;
Step (4.3): the search built in previous step in a recursive manner searches black picture element, simultaneously basis in facing territory Lookup result rebuilds search and faces territory;
Step (4.4): repeat above-mentioned recursive procedure until new black picture element cannot be obtained, and by these position phases Adjacent black picture element includes same connected domain in;
Step (4.5): continue checking for the non-scanning element of the next one, search more connected region.
Further, the point extracting Curvature varying bigger described in step (5) is four curvature in each connected domain The angle point changed greatly.
By such scheme, the present invention at least has the advantage that this augmented reality view field space and virtual three-dimensional target Dynamic registration method ensure that correct registration relation, improves registration accuracy, improves the verity on user's sense organ.
Described above is only the general introduction of technical solution of the present invention, in order to better understand the technological means of the present invention, And can be practiced according to the content of description, after describing in detail such as with presently preferred embodiments of the present invention below.
Detailed description of the invention
Below in conjunction with embodiment, the detailed description of the invention of the present invention is described in further detail.Following example are used for The present invention is described, but is not limited to the scope of the present invention.
Embodiment: a kind of augmented reality view field space and virtual three-dimensional target dynamic method for registering, comprises the following steps:
Step (1): obtain real scene information and camera location information;
Step (2): first counted according to the telltale mark in the positional information of camera and real scene by picture system Calculate the dummy object coordinate affine transformation to camera view plane, then according to affine transformation matrix draws virtual object on view plane Body, is finally directly shown by optical perspective Helmet Mounted Display, obtains augmented reality system diagram picture;
Step (3): the image showing optical perspective Helmet Mounted Display carries out binarization segmentation, according to image after segmentation Gamma characteristic judges that in augmented reality system diagram picture, which partly belongs to environmental background, and which partly belongs to mark;
Step (4): bianry image is done connected domain analysis, by the black picture element that search area in bianry image is bigger Region determines mark view field;
Step (5): the point that extraction Curvature varying is bigger in mark view field, thus the shape of explication connected domain Shape;
Step (6): the shape of connected domain be mapped with threedimensional model in picture system, draws matching result, root The correct threedimensional model of marker is drawn according to matching result.
The mode obtaining real scene information and camera location information described in step (1) is by using camera head And light-sensitive device receives light source and the image with geometric distribution, then by calculating acquisition information.
Calculating dummy object coordinate described in step (2) is to pass through spatial point to the mode of the affine transformation of camera view plane Three-dimensional coordinate position select the dummy object in real scene.
Binarization segmentation mode described in step (3) is to use histogram thresholding split-run.
Connected domain analysis described in step (4) comprises the following steps:
Step (4.1): searching for black picture element from whole bianry image, search is from the beginning of the upper left corner of image, with line order It is as the criterion and carries out successively;
Step (4.2): for a black picture element detected, be set to scan by its flag bit, and build with this Territory is faced in the search of individual 3*3 big centered by pixel;
Step (4.3): the search built in previous step in a recursive manner searches black picture element, simultaneously basis in facing territory Lookup result rebuilds search and faces territory;
Step (4.4): repeat above-mentioned recursive procedure until new black picture element cannot be obtained, and by these position phases Adjacent black picture element includes same connected domain in;
Step (4.5): continue checking for the non-scanning element of the next one, search more connected region.
The point extracting Curvature varying bigger described in step (5) is that in each connected domain, four Curvature varying are bigger Angle point.
The above is only the preferred embodiment of the present invention, is not limited to the present invention, it is noted that for this skill For the those of ordinary skill in art field, on the premise of without departing from the technology of the present invention principle, it is also possible to make some improvement and Modification, these improve and modification also should be regarded as protection scope of the present invention.

Claims (6)

1. an augmented reality view field space and virtual three-dimensional target dynamic method for registering, it is characterised in that: comprise the following steps:
Step (1): obtain real scene information and camera location information;
Step (2): first calculate void according to the telltale mark in the positional information of camera and real scene by picture system Intend the object coordinates affine transformation to camera view plane, then according to affine transformation matrix draws dummy object on view plane, Finally directly shown by optical perspective Helmet Mounted Display, obtain augmented reality system diagram picture;
Step (3): the image showing optical perspective Helmet Mounted Display carries out binarization segmentation, according to the gray scale of image after segmentation Characteristic judges that in augmented reality system diagram picture, which partly belongs to environmental background, and which partly belongs to mark;
Step (4): bianry image is done connected domain analysis, by the black-pixel region that search area in bianry image is bigger Determine mark view field;
Step (5): the point that extraction Curvature varying is bigger in mark view field, thus the shape of explication connected domain;
Step (6): in picture system, the shape of connected domain is mapped with threedimensional model, draws matching result, according to Join result and draw the correct threedimensional model of marker.
Augmented reality view field space the most according to claim 1 and virtual three-dimensional target dynamic method for registering, its feature exists In: the mode obtaining real scene information and camera location information described in step (1) is by using camera head and light Sensing device receives light source and the image with geometric distribution, then by calculating acquisition information.
Augmented reality view field space the most according to claim 2 and virtual three-dimensional target dynamic method for registering, its feature exists In: the mode of calculating dummy object coordinate described in step (2) to the affine transformation of camera view plane is three by spatial point Dimension coordinate position selects the dummy object in real scene.
Augmented reality view field space the most according to claim 3 and virtual three-dimensional target dynamic method for registering, its feature exists In: the binarization segmentation mode described in step (3) is to use histogram thresholding split-run.
Augmented reality view field space the most according to claim 4 and virtual three-dimensional target dynamic method for registering, its feature exists In: the connected domain analysis described in step (4) comprises the following steps:
Step (4.1): search for black picture element from whole bianry image, search, from the beginning of the upper left corner of image, is as the criterion with line order Carry out successively;
Step (4.2): for a black picture element detected, be set to scan by its flag bit, and build with this pixel Centered by the search of individual 3*3 big face territory;
Step (4.3): the search built in previous step in a recursive manner searches black picture element in facing territory, simultaneously according to lookup Result rebuilds search and faces territory;
Step (4.4): repeat above-mentioned recursive procedure until new black picture element cannot be obtained, and by adjacent for these positions Black picture element includes same connected domain in;
Step (4.5): continue checking for the non-scanning element of the next one, search more connected region.
Augmented reality view field space the most according to claim 5 and virtual three-dimensional target dynamic method for registering, its feature exists In: the point extracting Curvature varying bigger described in step (5) is the angle point that in each connected domain, four Curvature varying are bigger.
CN201610582291.9A 2016-07-21 2016-07-21 Augmented reality view field space and virtual three-dimensional target dynamic method for registering Active CN106249881B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201610582291.9A CN106249881B (en) 2016-07-21 2016-07-21 Augmented reality view field space and virtual three-dimensional target dynamic method for registering

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201610582291.9A CN106249881B (en) 2016-07-21 2016-07-21 Augmented reality view field space and virtual three-dimensional target dynamic method for registering

Publications (2)

Publication Number Publication Date
CN106249881A true CN106249881A (en) 2016-12-21
CN106249881B CN106249881B (en) 2019-03-19

Family

ID=57603611

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201610582291.9A Active CN106249881B (en) 2016-07-21 2016-07-21 Augmented reality view field space and virtual three-dimensional target dynamic method for registering

Country Status (1)

Country Link
CN (1) CN106249881B (en)

Cited By (19)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108762501A (en) * 2018-05-23 2018-11-06 歌尔科技有限公司 AR display methods, intelligent terminal, AR equipment and system
CN109085931A (en) * 2018-07-25 2018-12-25 南京禹步信息科技有限公司 A kind of interactive input method, device and storage medium that actual situation combines
CN109310476A (en) * 2016-03-12 2019-02-05 P·K·朗 Apparatus and method for operation
CN109658523A (en) * 2018-12-10 2019-04-19 西安小明出行新能源科技有限公司 The method for realizing each function operation instruction of vehicle using the application of AR augmented reality
CN109685905A (en) * 2017-10-18 2019-04-26 深圳市掌网科技股份有限公司 Cell planning method and system based on augmented reality
CN109692487A (en) * 2018-12-06 2019-04-30 安徽教育网络出版有限公司 A kind of operating method of the augmented reality of Huangmei Opera
CN109840949A (en) * 2017-11-29 2019-06-04 深圳市掌网科技股份有限公司 Augmented reality image processing method and device based on optical alignment
CN109840934A (en) * 2017-11-29 2019-06-04 深圳市掌网科技股份有限公司 A kind of the threedimensional model generation method and system of workpiece
CN110097638A (en) * 2018-01-31 2019-08-06 深圳市掌网科技股份有限公司 Virtual object method for drafting and device based on combined tracking device
CN110120060A (en) * 2018-02-06 2019-08-13 广东虚拟现实科技有限公司 Recognition methods, device and the recognition and tracking system of marker
CN110120100A (en) * 2018-02-06 2019-08-13 广东虚拟现实科技有限公司 Image processing method, device and recognition and tracking system
CN110619674A (en) * 2019-08-15 2019-12-27 重庆特斯联智慧科技股份有限公司 Three-dimensional augmented reality equipment and method for accident and alarm scene restoration
CN110769225A (en) * 2018-12-29 2020-02-07 成都极米科技股份有限公司 Projection area obtaining method based on curtain and projection device
WO2020140524A1 (en) * 2019-01-02 2020-07-09 珠海格力电器股份有限公司 Augmented reality display method and device for chip structure, and readable storage medium
CN111754570A (en) * 2019-03-26 2020-10-09 广东虚拟现实科技有限公司 Marker and method for identifying marker
CN112651943A (en) * 2020-12-28 2021-04-13 南京佗道医疗科技有限公司 Three-dimensional image mark point extraction method
CN113344990A (en) * 2021-04-27 2021-09-03 成都飞机工业(集团)有限责任公司 Hole site representation projection system and hole site alignment method of self-adaptive fitting
CN113349928A (en) * 2021-05-20 2021-09-07 清华大学 Augmented reality surgical navigation device and method for flexible instrument
WO2022120714A1 (en) * 2020-12-10 2022-06-16 西安大医集团股份有限公司 Image segmentation method and apparatus, image guidance system, and radiotherapy system

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101923809A (en) * 2010-02-12 2010-12-22 黄振强 Interactive augment reality jukebox
CN103297681A (en) * 2012-03-02 2013-09-11 卡西欧计算机株式会社 Image processing device and image processing method
CN104102678A (en) * 2013-04-15 2014-10-15 腾讯科技(深圳)有限公司 Method and device for realizing augmented reality
WO2014172484A1 (en) * 2013-04-16 2014-10-23 DotProduct LLC Handheld portable optical scanner and method of using

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101923809A (en) * 2010-02-12 2010-12-22 黄振强 Interactive augment reality jukebox
CN103297681A (en) * 2012-03-02 2013-09-11 卡西欧计算机株式会社 Image processing device and image processing method
CN104102678A (en) * 2013-04-15 2014-10-15 腾讯科技(深圳)有限公司 Method and device for realizing augmented reality
WO2014172484A1 (en) * 2013-04-16 2014-10-23 DotProduct LLC Handheld portable optical scanner and method of using

Cited By (23)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109310476B (en) * 2016-03-12 2020-04-03 P·K·朗 Devices and methods for surgery
CN109310476A (en) * 2016-03-12 2019-02-05 P·K·朗 Apparatus and method for operation
CN109685905A (en) * 2017-10-18 2019-04-26 深圳市掌网科技股份有限公司 Cell planning method and system based on augmented reality
CN109840949A (en) * 2017-11-29 2019-06-04 深圳市掌网科技股份有限公司 Augmented reality image processing method and device based on optical alignment
CN109840934A (en) * 2017-11-29 2019-06-04 深圳市掌网科技股份有限公司 A kind of the threedimensional model generation method and system of workpiece
CN110097638B (en) * 2018-01-31 2023-04-28 深圳市掌网科技股份有限公司 Virtual object drawing method and device based on hybrid tracker
CN110097638A (en) * 2018-01-31 2019-08-06 深圳市掌网科技股份有限公司 Virtual object method for drafting and device based on combined tracking device
CN110120060A (en) * 2018-02-06 2019-08-13 广东虚拟现实科技有限公司 Recognition methods, device and the recognition and tracking system of marker
CN110120100A (en) * 2018-02-06 2019-08-13 广东虚拟现实科技有限公司 Image processing method, device and recognition and tracking system
CN108762501A (en) * 2018-05-23 2018-11-06 歌尔科技有限公司 AR display methods, intelligent terminal, AR equipment and system
CN109085931A (en) * 2018-07-25 2018-12-25 南京禹步信息科技有限公司 A kind of interactive input method, device and storage medium that actual situation combines
CN109692487A (en) * 2018-12-06 2019-04-30 安徽教育网络出版有限公司 A kind of operating method of the augmented reality of Huangmei Opera
CN109658523A (en) * 2018-12-10 2019-04-19 西安小明出行新能源科技有限公司 The method for realizing each function operation instruction of vehicle using the application of AR augmented reality
CN109658523B (en) * 2018-12-10 2023-05-09 田海玉 Method for realizing use description of various functions of vehicle by AR augmented reality application
CN110769225A (en) * 2018-12-29 2020-02-07 成都极米科技股份有限公司 Projection area obtaining method based on curtain and projection device
WO2020140524A1 (en) * 2019-01-02 2020-07-09 珠海格力电器股份有限公司 Augmented reality display method and device for chip structure, and readable storage medium
CN111754570A (en) * 2019-03-26 2020-10-09 广东虚拟现实科技有限公司 Marker and method for identifying marker
CN110619674A (en) * 2019-08-15 2019-12-27 重庆特斯联智慧科技股份有限公司 Three-dimensional augmented reality equipment and method for accident and alarm scene restoration
WO2022120714A1 (en) * 2020-12-10 2022-06-16 西安大医集团股份有限公司 Image segmentation method and apparatus, image guidance system, and radiotherapy system
CN112651943A (en) * 2020-12-28 2021-04-13 南京佗道医疗科技有限公司 Three-dimensional image mark point extraction method
CN113344990A (en) * 2021-04-27 2021-09-03 成都飞机工业(集团)有限责任公司 Hole site representation projection system and hole site alignment method of self-adaptive fitting
CN113344990B (en) * 2021-04-27 2022-09-20 成都飞机工业(集团)有限责任公司 Hole site representation projection system and self-adaptive fitting hole site alignment method
CN113349928A (en) * 2021-05-20 2021-09-07 清华大学 Augmented reality surgical navigation device and method for flexible instrument

Also Published As

Publication number Publication date
CN106249881B (en) 2019-03-19

Similar Documents

Publication Publication Date Title
CN106249881B (en) Augmented reality view field space and virtual three-dimensional target dynamic method for registering
Liu et al. A detection and recognition system of pointer meters in substations based on computer vision
US7965904B2 (en) Position and orientation measuring apparatus and position and orientation measuring method, mixed-reality system, and computer program
CN106780619B (en) Human body size measuring method based on Kinect depth camera
CN102612704B (en) Method of providing a descriptor for at least one feature of an image and method of matching features
WO2019080229A1 (en) Chess piece positioning method and system based on machine vision, storage medium, and robot
KR100411875B1 (en) Method for Stereo Image Disparity Map Fusion And Method for Display 3-Dimension Image By Using it
Kumar Mishra et al. A review of optical imagery and airborne lidar data registration methods
CN110443898A (en) A kind of AR intelligent terminal target identification system and method based on deep learning
CN111784775B (en) Identification-assisted visual inertia augmented reality registration method
CN106295512B (en) Vision data base construction method and indoor orientation method in more correction lines room based on mark
Urban et al. Finding a good feature detector-descriptor combination for the 2D keypoint-based registration of TLS point clouds
CN103839277A (en) Mobile augmented reality registration method of outdoor wide-range natural scene
CN113011388A (en) Vehicle outer contour size detection method based on license plate and lane line
CN115830135A (en) Image processing method and device and electronic equipment
JP6942566B2 (en) Information processing equipment, information processing methods and computer programs
CN106504257B (en) A kind of radiotherapy head position attitude measuring and calculation method
CN117911668A (en) Drug information identification method and device
CN105631849B (en) The change detecting method and device of target polygon
CN106780577B (en) A kind of matching line segments method based on group feature
CN117611525A (en) Visual detection method and system for abrasion of pantograph slide plate
CN105184736B (en) A kind of method of the image registration of narrow overlapping double-view field hyperspectral imager
CN113112546B (en) Space target detection identification and pose tracking method based on three-X combined marker
CN115272417A (en) Image data processing method, image processing apparatus, and readable storage medium
CN110674817B (en) License plate anti-counterfeiting method and device based on binocular camera

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
PE01 Entry into force of the registration of the contract for pledge of patent right

Denomination of invention: Dynamic registration method of augmented reality field of view space and virtual 3D target

Effective date of registration: 20211124

Granted publication date: 20190319

Pledgee: Shandong Dream Vision Intelligent Technology Co.,Ltd.

Pledgor: JIANGSU AUGUST INFORMATION TECHNOLOGY Inc.

Registration number: Y2021980013202

PE01 Entry into force of the registration of the contract for pledge of patent right