CN102903142A - Method for realizing three-dimensional augmented reality - Google Patents

Method for realizing three-dimensional augmented reality Download PDF

Info

Publication number
CN102903142A
CN102903142A CN2012103981429A CN201210398142A CN102903142A CN 102903142 A CN102903142 A CN 102903142A CN 2012103981429 A CN2012103981429 A CN 2012103981429A CN 201210398142 A CN201210398142 A CN 201210398142A CN 102903142 A CN102903142 A CN 102903142A
Authority
CN
China
Prior art keywords
dimensional
card
picture
dimensional model
virtual
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN2012103981429A
Other languages
Chinese (zh)
Inventor
刘群
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
TIANJIN JIAMA FILM AND TELEVISION ANIMATION CULTURE COMMUNICATION CO Ltd
Original Assignee
TIANJIN JIAMA FILM AND TELEVISION ANIMATION CULTURE COMMUNICATION CO Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by TIANJIN JIAMA FILM AND TELEVISION ANIMATION CULTURE COMMUNICATION CO Ltd filed Critical TIANJIN JIAMA FILM AND TELEVISION ANIMATION CULTURE COMMUNICATION CO Ltd
Priority to CN2012103981429A priority Critical patent/CN102903142A/en
Publication of CN102903142A publication Critical patent/CN102903142A/en
Pending legal-status Critical Current

Links

Images

Landscapes

  • Processing Or Creating Images (AREA)

Abstract

The invention discloses a method for realizing a three-dimensional augmented reality. The bottleneck that the number of bi-dimensional read pictures of the conventional augmented reality is broken; graphical picture pixels and color information of a marker are respectively read twice, so that a mapping relation between a virtual object and a real object is quickly and accurately constructed; patterns on the marker are attractive; and under any lighting condition, the information of the marker can be normally read. The method comprises the following steps of: initializing multimedia equipment and a photography device, and connecting the multimedia equipment and the photography device with a relevant three-dimensional model; acquiring a video frame of the marker through the photography device, wherein the marker is a picture or a card, and the patterns on the marker are fully colored; reading the video frame, and retrieving a corresponding virtual three-dimensional model in a three-dimensional database; positioning the virtual three-dimensional model and a coordinate axis of the video frame; and calling the retrieved virtual three-dimensional model, synthesizing the virtual three-dimensional model and the video frame, and outputting the video frame to a display for displaying.

Description

A kind of method that realizes three-dimensional enhanced reality
Technical field
The present invention relates to three-dimensional modeling and augmented reality field, relate in particular to a kind of method that realizes three-dimensional enhanced reality.
Background technology
Augmented reality, it is a kind of technology that combines the Computer Subjects such as image recognition is followed the trail of, motion-captured, virtual reality, with virtual three-dimensional model animation, video, literal, the real-time Overlapping display of picture digital information in real scene, and realize the human-computer interaction technology of the innovation of nature interaction with real object or user, be widely used in every field, hold a colored card such as the user, by reading of camera, present actual situation that the 3-D view corresponding with the pattern on the card and colour picture merge mutually in the display in conjunction with presenting.
In the prior art, pattern on the two dimensional image that camera head reads comprises two-dimensional visualization coding and multicolour pattern, it is complicated that the augmented reality module of tradition multicolour pattern reads the image content pixel, so larger to program and camera identification load, substantially can only realize that single picture reads, substantially can not finish many picture operations, saying nothing of has been a large amount of pictures.
The two-dimensional visualization coding is a kind of coding pattern that is similar to bar code, and this visual coding can be used as the unique identification of mark.Camera on the multimedia equipments such as computing machine, mobile phone and panel computer can detect the mark with the two-dimensional visualization coding.
But there is following defective in above-mentioned two-dimension code read mode:
Two-dimension code arranges in picture to be identified or the position on the card and shared size need to affect the pattern picture of picture or card vivid, particularly for some mark that the aesthetic measure of pattern is relatively paid close attention to, for example game card;
Augmented reality reads according to the simple pixel graphics of two-dimension code, realize the most basic image recognition, although this mode fast recognition, but, when the picture number that will read large (general about 200), game card for example, read the large figure of amount like this, can cause reading images chaotic, slow in reacting makeing mistakes, its causes of mistake:
Two-dimension code is the dot matrix image information take pixel as unit, array pattern is relatively single, the mode of the multidigit permutation and combination that adopts is distinguished two-dimension code, this has just had higher requirement to the recognition capability of identification equipment, in addition because for example restriction of the size of card (8.3x6.3cm) own, the two-dimension code size is unsuitable excessive, so in the situation that the identification of camera medium and long distance will produce and obscure or can't read, this moment, two-dimension code was unsuitable for the Application and Development of augmented reality;
What the conventional two-dimensional code adopted in addition is black and white identification, recognition speed is fast under normal circumstances owing to color value contrast maximum (white R:255B:255G:255 black R:0G:0B:0) although it is so, but relatively high to printing sheets and environmental requirement, if under high light affects first, can change color numerical value (variation of black under the high light), cause the problem that to identify.
Summary of the invention
The problem to be solved in the present invention provides a kind of method that realizes three-dimensional enhanced reality, is used for setting up fast and accurately the mapping relations between the actual situation object when identifying a large amount of colour pictures or card.
Technical scheme of the present invention is as follows:
A kind of method that realizes three-dimensional enhanced reality comprises the steps:
A: initialization multimedia equipment, the camera head that connects on it connect with the three-dimensional model of being connected;
B: obtain the frame of video of mark by camera head, described mark is picture or card, and the pattern on it is full color;
C: described frame of video is read, obtain colour picture or card relevant information, thereby retrieve virtual three-dimensional model corresponding in the three-dimensional modeling data storehouse, the three-dimensional model in the described three-dimensional modeling data storehouse utilizes dimensional Modeling Technology, color drawing for curved surface of body technology and pinup picture technology to finish;
D: the coordinate axis to virtual three-dimensional model and frame of video positions;
E: the virtual three-dimensional model that will retrieve accesses with frame of video and synthesizes, and finishes the actual situation combination, and outputs to display and show.
Preferably, among the described step C described frame of video is read, comprise that secondary reads process, read for the first time the graph outline information on colour picture or the card, finish the preliminary search location, read the graphic color information on colour picture or the card for the second time, final affirmation location.
Preferably, the mark among the described step B is before printing, and the pattern on it passes through following processing procedure:
Reduce picture size fast to guarantee that data speed is transferred on the backstage; Pattern is carried out subject content refine, remove unnecessary lines; Strengthen saturation degree and the contrast of image; The obfuscation imaging surface; Picture to image carries out pixelation, to improve reading speed.
Preferably, the pattern among the described step B on colour picture or the card is full-color 240,000 looks, comprises personage, scene and stage property.
Preferably, described three-dimensional model comprises the three dimensional character model corresponding with personage, scene and stage property on picture or the card, three-dimensional scene models and three-dimensional prop model, wherein each personage's three-dimensional model is lower than 2000, and each three-dimensional scene models or three-dimensional prop model are lower than 1000.
What preferably, read that graph outline information on colour picture or the card utilizes the described first time is the multidimensional gradient method.
Beneficial effect of the present invention is: broken through traditional augmented reality two-dimension code and read the few bottleneck that to get of number of pictures, in augmented reality, by reading respectively graphic picture pixel and the colouring information of mark for twice, set up fast and accurately the mapping relations between the actual situation object; And the pattern on the mark is attractive in appearance, does not have the distinguishing mark part of the whole pattern layout of unnecessary impact; And under any light condition, can both normally read the information of mark.
Description of drawings
Fig. 1 is process flow diagram of the present invention;
Fig. 2 is the design sketch after card example of the present invention discolors;
Fig. 3 is that the line exterior feature that card example of the present invention carries out obtaining after profile extracts is schemed;
Fig. 4 is that card example of the present invention carries out the color design sketch in when identification;
Fig. 5 is the overlay chart after card example of the present invention carries out twi-read.
Embodiment
Below in conjunction with accompanying drawing preferred embodiment of the present invention is made brief description.
As shown in Figure 1, exemplary application of the present invention needs to realize identifying fast and accurately a large amount of card information in the card field of play;
A kind of method that realizes three-dimensional enhanced reality comprises the steps:
10: initialization multimedia equipment, the camera head that connects on it connect with the three-dimensional model of being connected;
Multimedia equipment is optimized, makes camera head under fuzzy state, still can read fast the coordinate of mark card, can load in a large number color image information by initialization;
In step 10 front, in line with optimizing first the theory of identifying behind the figure, the mark card that is identified is before being printed to playing cards, and the pattern of card passes through the processing procedure of following steps:
The picture size that reduces card is fast to guarantee that data speed is transferred on the backstage;
Card is carried out picture optimization, original painting is carried out subject content refine, remove unnecessary lines;
The card color is optimized, strengthens saturation degree and the contrast of image;
The imaging surface of obfuscation card is intended to accurate blurred picture, can improve the camera fuzzy diagnosis to the interval degree of clear identification;
Picture to card carries out pixelation, to improve reading speed;
After the image effect figure of the card that finally obtains discolors how shown in 2;
20: obtain the frame of video of mark by camera head, described mark is that 200 patterns are full-color 240,000 looks, comprises the card of personage, scene and stage property;
When reading card, card can be placed in the cassette tape and read, and camera is in the situation that low pixel still obtains fast reading speed;
30: described frame of video is read, obtain the relevant information of card, thereby retrieve virtual three-dimensional model corresponding in the three-dimensional modeling data storehouse;
Wherein, comprise the three-dimensional drawing technology of utilizing in the described three-dimensional modeling data storehouse, color drawing for curved surface of body technology and pinup picture technology finish with card on the personage, the three dimensional character model that scene or stage property are corresponding, three-dimensional scene models and three-dimensional prop model, taked low accuracy model and high precision to draw the mode of pinup picture, face number and fixed-point number to model are strictly controlled, wherein each personage's three-dimensional model is lower than 2000, each three-dimensional scene models or three-dimensional prop model are lower than 1000, guaranteeing under the three-dimensional model condition attractive in appearance, to the minimizing of large limit the database committed memory the space and greatly improved the speed that reads;
Because because discrete error can appear in the camera mass discrepancy, cause reading confusion or read stack, described frame of video read comprise following two steps:
31 first steps read the line original text of the pattern of frame of video, by line manuscript base district, tentatively distinguish card information, confirm which the card information that is that reads;
Be specially: the pattern to frame of video carries out level and smooth and binary conversion treatment, carry out afterwards detection and the extraction of pattern edge, obtain the string diagram of pattern on the card, specifically adopt Gauss in the multidimensional gradient method-Laplace operator algorithm to carry out Image Edge-Detection and extraction; The processing that image before for example Fig. 2 being discolored carries out above-mentioned steps obtains string diagram for example shown in Figure 3;
32 second steps read the graphic color information of frame of video, are 320,000 wide colour gamut read modes because color reads employing, so even also can guarantee the accuracy that reads in the process reading of a large amount of cards;
Be specially: the pixel of pattern is classified according to color, and the method that color classification is commonly used has linear color threshold method, nearest-neighbor method and threshold vector method; Afterwards, the pixel of adjacent same color is linked to be color lump, color lump is identified, calculate the method realize target coupling of similarity according to colouring information; Image when the image before for example Fig. 2 being discolored carries out color identification as shown in Figure 4;
By eclipse effect after twice identification, as shown in Figure 5, card is identified, and corresponding three-dimensional model in the accurate location model database;
40: the coordinate axis to virtual three-dimensional model and frame of video positions;
50: the virtual three-dimensional model that will retrieve accesses with frame of video and synthesizes, and finishes the actual situation combination, and outputs to display and show.
Above one embodiment of the present of invention are had been described in detail, but described content only is preferred embodiment of the present invention, can not be considered to be used to limiting practical range of the present invention.All equalizations of doing according to the present patent application scope change and improve etc., all should still belong within the patent covering scope of the present invention.

Claims (6)

1. a method that realizes three-dimensional enhanced reality is characterized in that: comprise the steps:
A: initialization multimedia equipment, the camera head that connects on it connect with the three-dimensional model of being connected;
B: obtain the frame of video of mark by camera head, described mark is picture or card, and the pattern on it is full color;
C: described frame of video is read, obtain colour picture or card relevant information, thereby retrieve virtual three-dimensional model corresponding in the three-dimensional modeling data storehouse, the three-dimensional model in the described three-dimensional modeling data storehouse utilizes dimensional Modeling Technology, color drawing for curved surface of body technology and pinup picture technology to finish;
D: the coordinate axis to virtual three-dimensional model and frame of video positions;
E: the virtual three-dimensional model that will retrieve accesses with frame of video and synthesizes, and finishes the actual situation combination, and outputs to display and show.
2. the method for realization three-dimensional enhanced reality according to claim 1, it is characterized in that: among the described step C described frame of video is read, comprise that secondary reads process, read for the first time the graph outline information on colour picture or the card, finish the preliminary search location, read for the second time the graphic color information on colour picture or the card, final affirmation location.
3. the method for realization three-dimensional enhanced reality according to claim 1 is characterized in that: the mark among the described step B is before printing, and the pattern on it is through following processing procedure:
Reduce picture size fast to guarantee that data speed is transferred on the backstage; Pattern is carried out subject content refine, remove unnecessary lines; Strengthen saturation degree and the contrast of image; The obfuscation imaging surface; Picture to image carries out pixelation, to improve reading speed.
4. the method for realization three-dimensional enhanced reality according to claim 1, it is characterized in that: the pattern among the described step B on colour picture or the card is full-color 240,000 looks, comprises personage, scene and stage property.
5. the method for realization three-dimensional enhanced reality according to claim 4, it is characterized in that: described three-dimensional model comprises the three dimensional character model corresponding with personage, scene and stage property on picture or the card, three-dimensional scene models and three-dimensional prop model, wherein each personage's three-dimensional model is lower than 2000, and each three-dimensional scene models or three-dimensional prop model are lower than 1000.
6. the method for realization three-dimensional enhanced reality according to claim 2 is characterized in that: what the graph outline information on colour picture or the card of reading the described first time was utilized is the multidimensional gradient method.
CN2012103981429A 2012-10-18 2012-10-18 Method for realizing three-dimensional augmented reality Pending CN102903142A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN2012103981429A CN102903142A (en) 2012-10-18 2012-10-18 Method for realizing three-dimensional augmented reality

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN2012103981429A CN102903142A (en) 2012-10-18 2012-10-18 Method for realizing three-dimensional augmented reality

Publications (1)

Publication Number Publication Date
CN102903142A true CN102903142A (en) 2013-01-30

Family

ID=47575354

Family Applications (1)

Application Number Title Priority Date Filing Date
CN2012103981429A Pending CN102903142A (en) 2012-10-18 2012-10-18 Method for realizing three-dimensional augmented reality

Country Status (1)

Country Link
CN (1) CN102903142A (en)

Cited By (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104143125A (en) * 2014-01-24 2014-11-12 中国建筑第四工程局有限公司 Engineering project visualization system management method
CN105358225A (en) * 2013-04-30 2016-02-24 Kabam公司 System and method for enhanced video of game playback
CN105405168A (en) * 2015-11-19 2016-03-16 青岛黑晶信息技术有限公司 Method and apparatus for implementing three-dimensional augmented reality
CN105844979A (en) * 2015-12-15 2016-08-10 齐建明 Augmented reality book, and education system and method based on augmented reality book
CN106200960A (en) * 2016-07-07 2016-12-07 深圳市大熊动漫文化有限公司 The content display method of electronic interactive product and device
CN106600669A (en) * 2016-12-22 2017-04-26 郑州正电电子技术有限公司 Device based on variable-color fluorescent drawing board and augmented reality, and operation method
CN106875461A (en) * 2015-12-10 2017-06-20 青岛华正信息技术有限公司 One kind is tinted plane picture 3D model transformation systems and method
WO2017173918A1 (en) * 2016-04-06 2017-10-12 北京小小牛创意科技有限公司 3d virtual environment generating method and device
CN107320955A (en) * 2017-06-23 2017-11-07 武汉秀宝软件有限公司 A kind of AR venue interface alternation method and system based on multi-client
CN107680105A (en) * 2017-10-12 2018-02-09 北京奇虎科技有限公司 Video data real-time processing method and device, computing device based on virtual world
CN107680170A (en) * 2017-10-12 2018-02-09 北京奇虎科技有限公司 View synthesis method and device based on virtual world, computing device
CN107862096A (en) * 2017-12-08 2018-03-30 快创科技(大连)有限公司 A kind of company information AC system based on AR augmented realities
CN108986191A (en) * 2018-07-03 2018-12-11 百度在线网络技术(北京)有限公司 Generation method, device and the terminal device of figure action
CN109903261A (en) * 2019-02-19 2019-06-18 北京奇艺世纪科技有限公司 A kind of image processing method, device and electronic equipment
CN110858376A (en) * 2018-08-22 2020-03-03 阿里巴巴集团控股有限公司 Service providing method, device, system and storage medium

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101593271B (en) * 2009-06-26 2011-09-28 上海久娱网络科技有限公司 System for identifying figures in card game machine
US20120083325A1 (en) * 2010-09-30 2012-04-05 Heatherly Christopher W Systems and methods to provide augmented reality for a board game
US20120122528A1 (en) * 2010-11-15 2012-05-17 Bally Gaming, Inc. System and method for augmented reality gaming using a mobile device

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101593271B (en) * 2009-06-26 2011-09-28 上海久娱网络科技有限公司 System for identifying figures in card game machine
US20120083325A1 (en) * 2010-09-30 2012-04-05 Heatherly Christopher W Systems and methods to provide augmented reality for a board game
US20120122528A1 (en) * 2010-11-15 2012-05-17 Bally Gaming, Inc. System and method for augmented reality gaming using a mobile device

Cited By (19)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105358225B (en) * 2013-04-30 2019-03-05 Kabam公司 The system and method for enhancing video for game video-recording and playback
CN105358225A (en) * 2013-04-30 2016-02-24 Kabam公司 System and method for enhanced video of game playback
CN104143125A (en) * 2014-01-24 2014-11-12 中国建筑第四工程局有限公司 Engineering project visualization system management method
CN105405168A (en) * 2015-11-19 2016-03-16 青岛黑晶信息技术有限公司 Method and apparatus for implementing three-dimensional augmented reality
CN106875461A (en) * 2015-12-10 2017-06-20 青岛华正信息技术有限公司 One kind is tinted plane picture 3D model transformation systems and method
CN105844979A (en) * 2015-12-15 2016-08-10 齐建明 Augmented reality book, and education system and method based on augmented reality book
WO2017173918A1 (en) * 2016-04-06 2017-10-12 北京小小牛创意科技有限公司 3d virtual environment generating method and device
US10740963B2 (en) 2016-04-06 2020-08-11 Beijing Xiaoxiaoniu Creative Technologies Ltd 3D virtual environment generating method and device
CN106200960A (en) * 2016-07-07 2016-12-07 深圳市大熊动漫文化有限公司 The content display method of electronic interactive product and device
CN106600669A (en) * 2016-12-22 2017-04-26 郑州正电电子技术有限公司 Device based on variable-color fluorescent drawing board and augmented reality, and operation method
CN107320955A (en) * 2017-06-23 2017-11-07 武汉秀宝软件有限公司 A kind of AR venue interface alternation method and system based on multi-client
CN107320955B (en) * 2017-06-23 2021-01-29 武汉秀宝软件有限公司 AR venue interface interaction method and system based on multiple clients
CN107680170A (en) * 2017-10-12 2018-02-09 北京奇虎科技有限公司 View synthesis method and device based on virtual world, computing device
CN107680105A (en) * 2017-10-12 2018-02-09 北京奇虎科技有限公司 Video data real-time processing method and device, computing device based on virtual world
CN107862096A (en) * 2017-12-08 2018-03-30 快创科技(大连)有限公司 A kind of company information AC system based on AR augmented realities
CN108986191A (en) * 2018-07-03 2018-12-11 百度在线网络技术(北京)有限公司 Generation method, device and the terminal device of figure action
CN110858376A (en) * 2018-08-22 2020-03-03 阿里巴巴集团控股有限公司 Service providing method, device, system and storage medium
CN109903261A (en) * 2019-02-19 2019-06-18 北京奇艺世纪科技有限公司 A kind of image processing method, device and electronic equipment
CN109903261B (en) * 2019-02-19 2021-04-09 北京奇艺世纪科技有限公司 Image processing method and device and electronic equipment

Similar Documents

Publication Publication Date Title
CN102903142A (en) Method for realizing three-dimensional augmented reality
CN108062776B (en) Camera Attitude Tracking method and apparatus
CN103503030B (en) Image processing device for specifying depth of object present in real space by performing image processing, stereoscopic viewing device, and integrated circuit
JP4584246B2 (en) How to display an output image on an object
CN103582893B (en) The two dimensional image represented for augmented reality is obtained
CN100470452C (en) Method and system for implementing three-dimensional enhanced reality
JP5778967B2 (en) Information processing program, information processing method, information processing apparatus, and information processing system
CN101923791A (en) Method for learning Chinese by combining reality enhancing technique and plane reading material
US8847974B2 (en) Display processing apparatus
JP5756322B2 (en) Information processing program, information processing method, information processing apparatus, and information processing system
CN107992188A (en) Virtual reality exchange method, device and system
US20110055696A1 (en) Globe container
CN106056992A (en) Ar augmented reality teaching system
CN103268714A (en) Reading video pen, method for utilizing reading video pen to read book, and book for reading video pen
CN107077739A (en) Use the three dimensional indicia model construction and real-time tracking of monocular camera
CN110336973A (en) Information processing method and its device, electronic equipment and medium
CN103399629A (en) Method and device for capturing gesture displaying coordinates
CN111951333A (en) Automatic six-dimensional attitude data set generation method, system, terminal and storage medium
WO2020252976A1 (en) Video insertion method, apparatus and device, medium and system
WO2023272495A1 (en) Badging method and apparatus, badge detection model update method and system, and storage medium
CN114170409A (en) Method for automatically judging display label of three-dimensional model
CN115482285A (en) Image alignment method, device, equipment and storage medium
JP2013502634A (en) Apparatus and method for identifying objects using morphological coding
CN108305210B (en) Data processing method, device and storage medium
CN115104078A (en) System and method for enhanced remote collaboration

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C12 Rejection of a patent application after its publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20130130