CN105989623A - Implementation method of augmented reality application based on handheld mobile equipment - Google Patents
Implementation method of augmented reality application based on handheld mobile equipment Download PDFInfo
- Publication number
- CN105989623A CN105989623A CN201510075241.7A CN201510075241A CN105989623A CN 105989623 A CN105989623 A CN 105989623A CN 201510075241 A CN201510075241 A CN 201510075241A CN 105989623 A CN105989623 A CN 105989623A
- Authority
- CN
- China
- Prior art keywords
- scene
- application
- key frame
- user
- augmented reality
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Abstract
The invention relates to an implementation method of an augmented reality application based on handheld mobile equipment in the field of computer virtual reality. The implementation method comprises the steps of carrying out recognition and tracking on a pattern through client software deployed on the handheld mobile equipment, and establishing an initial application with the scene being empty in allusion to pattern positioning; then importing required materials from a material library, adding the required materials to the scene, and carrying out static scene implementation in the application through a graphical interface based visual operation; then carrying out dynamic scene implementation on the materials in the scene through a graphical interface based visual operation; and finally storing the implemented application to be an XML file, uploading the XML file to a server so as to complete release of the mobile augmented reality application. The implementation method provided by the invention simplifies the application implementation process, and improves the implementation efficiency of a user; and the user does not need to specify all key frames one by one, and the implementation efficiency and the accuracy of complex movement track animation are greatly improved.
Description
Technical field
The present invention relates to the technology in a kind of virtual reality technology field, a kind of enhancing based on handheld mobile device
Real world applications implementation method.
Background technology
Augmented reality have by characteristic integrated to real world information and virtual world information " seamless " so that it is manufacturing,
The various applications such as education have vast potential for future development.And due to universal (such as smart mobile phone and the panel computer) of handheld mobile device
With the development of other new techniques (as based on Quick Response Code, pattern identification based on physical feature and tracking), augmented reality also by
Step is applied to the Mobile solution fields such as guide to visitors, has embodied huge market potential and application prospect.But mobile augmented reality should at present
Exploitation relate to the coding work that a large amount of graphics and platform are relevant, therefore basic by professional's customized development according to demand.For
Simplify and realize flow process, reduce and realize difficulty, even allow the domestic consumer (hereinafter referred to as domestic consumer) that will not program also can apply
Design, the most popular for the design tool of mobile augmented reality application and the research of implementation method.
At present, the implementation method that the mobile augmented reality towards domestic consumer is applied is primarily present two large problems: first, existing shifting
It is complex that dynamic augmented reality application realizes flow process.General employing first encodes the flow process generated afterwards, i.e. user and is required for target pattern
Or other kinds of mark design virtual scene, then check final result by the way of compiling or issue.This flow process causes
User is thought and real income deviation, then makes user be absorbed in scene details and adjusts and cannot be absorbed in design application content.The
Two, existing instrument supports deficiency for the Visual Implementation of dynamic scene in application.Script is normally only provided to realize environment, for general
General family, this application implementation is difficult to grasp and use.
Through finding the retrieval of prior art, the mobile augmented reality Application Design instrument of current comparative maturity is by Metaio
The Metaio Creator software of company's exploitation, this tool part is deployed in PC, it is provided that for picture, real-world object, show
The visualization static scene design function of real environment etc. destination object, under three visual angles, the material in scene can be translated,
Rotation, zoom operations, the material of support includes pattern, threedimensional model, video etc., and provides script-editor by compiling
Write design and the realization of dynamic scene during AREL script (Augmented Reality Experience Language) is applied.But
This technology unresolved above-mentioned two large problems.
Chinese patent literature CN103150658A, publication date 2,013 06 12, describe that " a kind of terminaloriented user shows
Real strengthen custom-built system and method ", the method relates to computer augmented reality, image recognition, internet arena, particularly relate to based on
The reality of the terminaloriented user of the Internet strengthens custom-built system and method, specifically includes that service management unit, user design and produce
Unit, AR processing unit, installation kit packaged unit, installation kit administrative unit, user's notification unit.The method is by augmented reality
Content and technology realize being separated, it is provided that terminal use selects to customize the interactive interface of augmented reality content flexibly, backstage from
Dynamic generate augmented reality application installation kit, flexibly, quickly, accurately generate the required augmented reality application system customized of user.But should
Technology still have employed and traditional first encodes the flow process that realizes generated afterwards, and user need to be repeatedly through the stream designing and producing, packing, install
Augmented reality application is modified debugging by journey, is not suitable for based on handheld mobile device realizing situation when participating in the cintest.
Eitsuka M. and Hirakawa M. is at " IIAI International Conference on Advanced Applied
Informatics " on " the Authoring Animations of Virtual Objects in Augmented Reality Based 3D that delivers
Space " (2013) propose model cartoon implementing method in a kind of mobile augmented reality application based on definition key frame, use
It is difficult with script-editor with solution domestic consumer and realizes the problem of dynamic scene in application.The method is directed to threedimensional model
Rigid motion animation, inscribes when user specifies some, the attitude that model is the most corresponding in the scene, and the most a series of key frame is
System automatically carries out interpolation calculation at run time and generates intermediate frame key frame, thus generates the dynamic scene in application.But at model
When movement locus or attitudes vibration are complex, especially when comprising a large amount of curvilinear motion, a large amount of due to need user to specify one by one
Key frame, the suitability of the method is not enough.
Summary of the invention
The present invention is directed to deficiencies of the prior art, propose the application of a kind of augmented reality based on handheld mobile device and realize
Method, by realizing process simplification, arranging user is empty apply the time of running carrying out application realization, i.e. user to a scene
Operating application add needed for content, the operation of each step can demonstrate the final effect of this application, makes user obtain in time
Must feed back, realize efficiency improving the application of user.Dynamic scene in application is realized by method based on successive frame animation,
I.e. providing scribble function to allow user draw the movement locus of material in scene rapidly, system automatically generates a series of key frame subsequently
Describing this animation, user can carry out local and overall adjustment on this basis to animation.Compared with prior art, present invention letter
The application having changed user realizes flow process, allows users to realize augmented reality application quickly, user can be allowed to realize the most multiple simultaneously
The miscellaneous dynamic scene in augmented reality application.
The present invention is achieved by the following technical solutions:
The present invention relates to a kind of augmented reality application implementation method based on handheld mobile device, by being deployed in handheld mobile device
On client software pattern is identified and follows the tracks of, and be empty original application setting up scene for pattern location；Then from
Material database imports required material add to scene, the static scene in being applied by visualized operation based on graphical interfaces
Realize；By visualized operation based on graphical interfaces, the material in scene is carried out dynamic scene realization again；After finally realizing
Application saves as extending mark language form (XML) file the issue having held mobile augmented reality to apply that uploads onto the server.
The present invention specifically includes following steps:
Step one, carries out recognition and tracking based on physical feature, and sets up the initial movable that scene is sky predefined pattern
Augmented reality is applied；
Described pattern positions for scene, and the tracking link of this step determines in application virtual scene relative to the three of target pattern
Dimension coordinate system, this coordinate system for specify during follow-up realization material relative to the attitude of target pattern, i.e. position, angle and big
Little.
Step 2, by retrieval material database, adds required material in scene, and carries out static scene by visualized operation
Realize；
Described static scene realizes referring to: user uses the touch-control of the plane of reference and projection line auxiliary to adjust material in scene alternately
Attitude.
The described plane of reference refers to: crosses user in scene and chooses the central point p of material and specify virtual with grid of normal direction n
Plane Π.The plane of reference comprises and is parallel to target pattern and is perpendicular to target pattern and equipment oriented images first two all the time.
Described projection line refers to: the central point p of other the most selected materials in sceneiVertical line L to the plane of referencei。
Described adjustment material attitude, specifically includes following steps:
1) select mobile operation, material is moved to specific bit in space and puts；
2) select rotation process, material is rotated to required angle along any axle；
3) select zoom operations, material is zoomed to required size.
Described material pose adjustment step can be carried out by any order, and does not limit number of operations.
Step 3, carries out dynamic scene realization by visualized operation to the material in scene；
Described dynamic scene realizes referring to: for the material in scene, by the way of design successive frame animation, complete rigid body
The design of motion animation.
Dynamic scene realizes specifically comprising the steps of
1) choose material, select scribble function, by the plane of reference and the auxiliary of projection line, draw material motion in three dimensions
Track；
2) system can record user's touch point during scribble, and maps that to three-dimensional coordinate corresponding on current reference face
Point, and according to default movement velocity, these three-dimensional coordinate points are generated corresponding key frame timestamp, then complete the life of key frame
Become；
3) to existing key frame, user can carry out the adjustment partly or wholly gone up；
Described adjustment includes:
Editor's key frame: insert key frame, delete keys and select key frame and change the material attitude of its correspondence.
Change animation mode: be single or loop play by cartoon setting.
Change animation duration: adjusting animation time, system is each after recalculating adjustment according to the time interval between key frame
The timestamp of key frame.
Step 4, the application after realizing saves as XML format file the end that uploads onto the server.
Technique effect
Compared with prior art, the user that the present invention uses carries out the flow process realized in the time of running of application, gives birth to afterwards with first encoding
The flow process become is compared, and simplifies application and realizes flow process, and improve user realizes efficiency；
The dynamic scene implementation method based on successive frame animation that the present invention uses, can quickly create movement locus and make with scribble
For animation prototype, then it is that animation increases details by editor's key frame.Compared to Visual Dynamic during a few supports application at present
The implementation method of Scenario Design, it is not necessary to user specifies all of key frame one by one, drastically increases the reality of Comlex-locus animation
Existing efficiency and accuracy.
Accompanying drawing explanation
Fig. 1 is the flowchart that the present invention proposes.
Fig. 2 be the present invention realize exemplary plot.
Detailed description of the invention
Elaborating embodiments of the invention below, the present embodiment is implemented under premised on technical solution of the present invention,
Give detailed embodiment and concrete operating process, but protection scope of the present invention is not limited to following embodiment.
Embodiment 1
As it is shown in figure 1, the present embodiment have employed newton put scene.In this scene, newton puts the swing ball of the rightmost side and can fall,
After colliding adjacent swing ball, the swing ball of the leftmost side can be upspring.The augmented reality application comprising Three Dimensional Dynamic Scene can be vivid
Ground represents this physical phenomenon.The present embodiment uses the above-mentioned step that realizes to illustrate.
As it is shown in figure 1, the present embodiment comprises the steps:
Step one, user is empty application for the newly-built scene of target pattern.
Step 2, on the application foundation that step one is newly-built, user searches from model library and adds newton and puts model to scene
In, the reference attitude of the rightest swing ball is being adjusted by the auxiliary operation of the plane of reference with projection line, comprise the following specific steps that:
The first step, selects search operation, the model name " NewtonBall " of input retrieval, can return in all names herein and wrap
Model containing this key word.Selecting required model in the model retrieved, system is automatically added in scene.This step is by element
Material has imported in application scenarios；
Second step, clicks on rightmost side swing ball, the system display plane of reference in the scene, adjusts the rightmost side by mobile and rotation process
Swing ball reference attitude.
Step 3, based on the static scene in step 2, puts the swing ball of both sides right, left and realizes respectively and upspring newton
Animation, specifically comprises the following steps that
The first step, selects rightmost side swing ball, is drawn the fall trajectory of swing ball by scribble；
Second step, to the some p on tracki(i=0～n), wherein p0For starting point, pnFor end point, system is according to presetting speed
Degree v calculates corresponding timestamp ti(i=0～n): t0=0, ti=ti‐1+|pi‐pi‐1|/v (i=1～n).This step is retouched for generation
State the key frame of this animation；
3rd step, adjusts animation duration extremely required duration t ', and system recalculates key frame timestamp ti' (i=0～n): ti'=t0+
(ti–t0)/tn× t ' (i=0～n)；
4th step, chooses leftmost side swing ball, and inserts a frame key frame in the t ' moment, is used for keeping leftmost side swing ball in the rightmost side
Swing ball falls to colliding transfixion before adjacent swing ball.Then the track of upspringing of scribble swing ball；
5th step, system generates key frame with second step；
6th step, is adjusted the duration of animation of upspringing with the 3rd step.
Step 4, preserves application and also uploads onto the server, and application can be saved as XML format file and accesses by system herein.
The operating process of the present embodiment is as in figure 2 it is shown, figure (a) is initial space-time scene, and figure (b) is that user retrieves mould in model library
Type, figure (c) is that user adds newton in scene and puts model, and figure (d) is user touches the attitude of swing ball in spherical model adjusting, figure (e)
Being that user is realizing the whereabouts animation of rightmost side swing ball, figure (f) is that user is realizing the animation of upspringing of leftmost side swing ball, and figure (g) is
The static scene of Metaio Creator realizes environment, and figure (h) is that the dynamic scene of Metaio Creator realizes environment.Can from figure
To find out, this method is the most directly perceived, be prone to study, and the domestic consumer being also more suitable for programming uses.
Present invention could apply in middle school teaching field, teacher can be designed strengthening now for the illustration in textbook when preparing lessons
Real application, and application is uploaded onto the server, students can be applied by the Client browse on smart mobile phone or panel computer subsequently.
Compared with classroom methods of exhibiting such as traditional pattern, lantern slides, the augmented reality application comprising moving three-dimensional scene can be more directly perceived, raw
Knowledge point is shown by dynamic ground.
Claims (10)
1. an augmented reality application implementation method based on handheld mobile device, it is characterised in that by being deployed in hand-held movement
Pattern is identified and follows the tracks of by the client software on equipment, and is empty original application setting up scene for pattern location；So
After from material database, import required material add to scene, the static state in being applied by visualized operation based on graphical interfaces
Scene realization；By visualized operation based on graphical interfaces, the material in scene is carried out dynamic scene realization again；Finally will realize
After application save as XML file the issue having held mobile augmented reality to apply that uploads onto the server.
Method the most according to claim 1, is characterized in that, described method specifically includes following steps:
Step one, carries out recognition and tracking based on physical feature, and sets up the initial movable increasing that scene is sky predefined pattern
Strong real world applications；
Step 2, by retrieval material database, adds required material in scene, and it is real to carry out static scene by visualized operation
Existing；
Step 3, carries out dynamic scene realization by visualized operation to the material in scene；
Step 4, the application after realizing saves as XML format file the end that uploads onto the server.
Method the most according to claim 1 and 2, is characterized in that, described pattern positions for scene, the tracking of this step
Link determines in application that virtual scene is relative to the three-dimensional system of coordinate of target pattern, during this coordinate system is used for specifying follow-up realization
Material relative to the attitude of target pattern, i.e. position, angle and size.
Method the most according to claim 1 and 2, is characterized in that, described static scene realizes referring to: user uses ginseng
The touch-control examining face and projection line auxiliary adjusts the attitude of material in scene alternately.
Method the most according to claim 1 and 2, is characterized in that, the described plane of reference refers to: crosses user in scene and chooses
The central point p of material also specifies the virtual plane Π with grid of normal direction n；The plane of reference comprises and is parallel to target pattern and is perpendicular to
Target pattern and all the time equipment oriented image first two.
Method the most according to claim 1 and 2, is characterized in that, described projection line refers to: in scene, other are the most selected
The central point p of middle materialiVertical line L to the plane of referencei。
Method the most according to claim 1 and 2, is characterized in that, described adjustment material attitude, specifically includes following step
Rapid:
1) select mobile operation, material is moved to specific bit in space and puts；
2) select rotation process, material is rotated to required angle along any axle；
3) select zoom operations, material is zoomed to required size.
Method the most according to claim 1 and 2, is characterized in that, described dynamic scene realizes referring to: in scene
Material, by design successive frame animation by the way of, complete the design of rigid motion animation.
Method the most according to claim 1 and 2, is characterized in that, described dynamic scene realizes specifically comprising the steps of
1) choose material, select scribble function, by the plane of reference and the auxiliary of projection line, draw material motion rail in three dimensions
Mark；
2) system can record user's touch point during scribble, and maps that to three-dimensional coordinate point corresponding on current reference face,
And according to default movement velocity, these three-dimensional coordinate points are generated corresponding key frame timestamp, then complete the generation of key frame；
3) to existing key frame, user can carry out the adjustment partly or wholly gone up.
Method the most according to claim 1 and 2, is characterized in that, described adjustment includes:
Editor's key frame: insert key frame, delete keys and select key frame and change the material attitude of its correspondence；
Change animation mode: be single or loop play by cartoon setting；
Change animation duration: adjust animation time, system can recalculate adjustment according to the time interval between key frame after each pass
The timestamp of key frame.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510075241.7A CN105989623B (en) | 2015-02-12 | 2015-02-12 | The implementation method of augmented reality application based on handheld mobile device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510075241.7A CN105989623B (en) | 2015-02-12 | 2015-02-12 | The implementation method of augmented reality application based on handheld mobile device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN105989623A true CN105989623A (en) | 2016-10-05 |
| CN105989623B CN105989623B (en) | 2019-01-11 |
Family
ID=57042007
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510075241.7A Active CN105989623B (en) | 2015-02-12 | 2015-02-12 | The implementation method of augmented reality application based on handheld mobile device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105989623B (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2018233533A1 (en) * | 2017-06-23 | 2018-12-27 | 卢俊谚 | Editing device and system for on-line integrated augmented reality |
| CN109727504A (en) * | 2018-12-19 | 2019-05-07 | 安徽建筑大学 | A kind of animation interactive system based on Art Design |
| CN111475026A (en) * | 2020-04-10 | 2020-07-31 | 李斌 | Space positioning method based on mobile terminal application augmented virtual reality technology |
| CN111899348A (en) * | 2020-07-14 | 2020-11-06 | 四川深瑞视科技有限公司 | Projection-based augmented reality experiment demonstration system and method |
| CN113867872A (en) * | 2021-09-30 | 2021-12-31 | 北京市商汤科技开发有限公司 | Project editing method, device, equipment and storage medium |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102867333A (en) * | 2012-07-18 | 2013-01-09 | 西北工业大学 | DI-GUY-based virtual character behavior visualization method |
| CN103679204A (en) * | 2013-12-23 | 2014-03-26 | 上海安琪艾可网络科技有限公司 | Image identification and creation application system and method based on intelligent mobile device platform |
| CN103870485A (en) * | 2012-12-13 | 2014-06-18 | 华为终端有限公司 | Method and device for achieving augmented reality application |
-
2015
- 2015-02-12 CN CN201510075241.7A patent/CN105989623B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102867333A (en) * | 2012-07-18 | 2013-01-09 | 西北工业大学 | DI-GUY-based virtual character behavior visualization method |
| CN103870485A (en) * | 2012-12-13 | 2014-06-18 | 华为终端有限公司 | Method and device for achieving augmented reality application |
| CN103679204A (en) * | 2013-12-23 | 2014-03-26 | 上海安琪艾可网络科技有限公司 | Image identification and creation application system and method based on intelligent mobile device platform |
Non-Patent Citations (4)
| Title |
|---|
| JES´US GIMENO1 等: "AN OCCLUSION-AWARE AR AUTHORING TOOL FOR ASSEMBLY AND REPAIR TASKS", 《COMPUTER GRAPHICS THEORY AND APPLICATIONS》 * |
| MANABU EITSUKA 等: "Authoring Animations of Virtual Objects in Augmented Reality-based 3D Space", 《2013 SECOND IIAI INTERNATIONAL CONFERENCE ON ADVANCED APPLIED INFORMATICS》 * |
| TOBIAS LANGLOTZ 等: "Sketching up the world: in situ authoring for mobile Augmented Reality", 《PERSONAL AND UBIQUITOUS COMPUTING》 * |
| 邵兴旦: "易用型增强现实系统开发工具的设计与应用", 《中国优秀硕士学位论文全文数据库信息科技辑》 * |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2018233533A1 (en) * | 2017-06-23 | 2018-12-27 | 卢俊谚 | Editing device and system for on-line integrated augmented reality |
| CN109727504A (en) * | 2018-12-19 | 2019-05-07 | 安徽建筑大学 | A kind of animation interactive system based on Art Design |
| CN111475026A (en) * | 2020-04-10 | 2020-07-31 | 李斌 | Space positioning method based on mobile terminal application augmented virtual reality technology |
| CN111475026B (en) * | 2020-04-10 | 2023-08-22 | 李斌 | Spatial positioning method based on mobile terminal application augmented virtual reality technology |
| CN111899348A (en) * | 2020-07-14 | 2020-11-06 | 四川深瑞视科技有限公司 | Projection-based augmented reality experiment demonstration system and method |
| CN113867872A (en) * | 2021-09-30 | 2021-12-31 | 北京市商汤科技开发有限公司 | Project editing method, device, equipment and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN105989623B (en) | 2019-01-11 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| Cartwright et al. | Multimedia cartography | |
| CN105989623A (en) | Implementation method of augmented reality application based on handheld mobile equipment | |
| CN102609991B (en) | Volume-reduction optimization method for three-dimensional solid model | |
| Behzadan et al. | Integrated information modeling and visual simulation of engineering operations using dynamic augmented reality scene graphs | |
| CN107835436A (en) | A kind of real-time virtual reality fusion live broadcast system and method based on WebGL | |
| EP3329682A1 (en) | A system for compositing video with interactive, dynamically rendered visual aids | |
| CN105653510A (en) | Electronic homework correction method, device and system | |
| CN110120087A (en) | The label for labelling method, apparatus and terminal device of three-dimensional sand table | |
| Liarokapis et al. | Mobile augmented reality techniques for geovisualisation | |
| Zhang et al. | The Application of Folk Art with Virtual Reality Technology in Visual Communication. | |
| Huixian | The construction of virtual simulation platform for pingtan experimental area based on HTML5 and WebGL | |
| Kampa et al. | Smart authoring for location-based augmented reality storytelling applications | |
| Cao | Development and design case function comparison of panoramic roaming system of virtual museum based on Pano2VR | |
| CN115379278B (en) | Recording method and system for immersion type micro lessons based on augmented reality (XR) technology | |
| Chen et al. | Research on augmented reality system for childhood education reading | |
| Behzadan et al. | Enabling smooth and scalable dynamic 3D visualization of discrete-event construction simulations in outdoor augmented reality | |
| CN112184874A (en) | High-performance graphic marking, progress simulating and navigating method for lightweight three-dimensional model | |
| Wu et al. | Digital protection and inheritance of culture under the background of “The Belt and Road Initiative” | |
| Suki et al. | Discovering the Global Landscape of 3D Animation: A Bibliometric Analysis. | |
| Yang | Architectural Roaming Animation Based on VR Technology | |
| Ding et al. | Research on the Key Technology of Augmented Reality Technology in the Application and Development of Children's Plant Science Popularization Education | |
| Lai et al. | A Review of Virtual Display Construction Methods | |
| Duan et al. | Design and Implementation of Virtual Campus Roaming System Based on OpenGL and 3Ds Max | |
| Li | Summary of Computer Processing and Editing Technology for 2D Animation | |
| Zhou et al. | 3D Mathematical Modeling and Visualization Application Based on Virtual Reality Technology |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |