CN106774870A - A kind of augmented reality exchange method and system - Google Patents

A kind of augmented reality exchange method and system Download PDF

Info

Publication number
CN106774870A
CN106774870A CN201611130384.4A CN201611130384A CN106774870A CN 106774870 A CN106774870 A CN 106774870A CN 201611130384 A CN201611130384 A CN 201611130384A CN 106774870 A CN106774870 A CN 106774870A
Authority
CN
China
Prior art keywords
scene
terminal
coordinate system
dimensional coordinate
reality
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201611130384.4A
Other languages
Chinese (zh)
Inventor
胡德志
孙碧亮
吴永超
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Wuhan Bao Bao Software Co Ltd
Original Assignee
Wuhan Bao Bao Software Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Wuhan Bao Bao Software Co Ltd filed Critical Wuhan Bao Bao Software Co Ltd
Priority to CN201611130384.4A priority Critical patent/CN106774870A/en
Publication of CN106774870A publication Critical patent/CN106774870A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/003D [Three Dimensional] image rendering
    • G06T15/005General purpose rendering architectures
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00Manipulating 3D models or images for computer graphics
    • G06T19/006Mixed reality
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/131Protocols for games, networked simulations or virtual reality

Abstract

The present invention relates to a kind of augmented reality exchange method and system, augmented reality exchange method includes:S1:The scene image of reality scene is obtained by the camera of terminal, the virtual scene corresponding with reality scene is set up according to scene image, by rendering engine by virtual scene display in terminal;S2:The first three-dimensional coordinate system is set up by origin of the center of scene image, the second three-dimensional coordinate system is set up by origin of camera;S3:According to scene image, the first three-dimensional coordinate system and the second three-dimensional coordinate system, positional information and offset information of the terminal in reality scene are obtained, and be synchronized to server end;S4:The data syn-chronization of server end is included in terminal.The beneficial effects of the invention are as follows:The technical program is tracked and synchronous in server end by the positional information of the terminal hand-held to user, realizes the interaction of the online augmented reality of many people.

Description

A kind of augmented reality exchange method and system
Technical field
The present invention relates to augmented reality field, more particularly to a kind of augmented reality exchange method and system.
Background technology
Be added to virtual world in real world by augmented reality, is perceived by human sensory, surmounts so as to reach The sensory experience of reality.Interacting for people and augmented reality is important component in augmented reality, current augmented reality The interaction of middle application is substantially by modes such as identification, touch-control, acoustic control and sensings;But, it is not a kind of by three-dimensional at present Space coordinates is come the method that interacts.
The content of the invention
The technical problems to be solved by the invention are to provide a kind of augmented reality exchange method for realizing many people's online interactions And system.
The technical scheme that the present invention solves above-mentioned technical problem is as follows:
A kind of augmented reality exchange method, the augmented reality exchange method includes:
S1:The scene image of reality scene is obtained by the camera of terminal, according to the scene image set up with it is described The corresponding virtual scene of reality scene, by rendering engine by the virtual scene display in the terminal;
S2:The first three-dimensional coordinate system is set up by origin of the center of the scene image, with the camera as former Point sets up the second three-dimensional coordinate system;
S3:According to the scene image, first three-dimensional coordinate system and second three-dimensional coordinate system, obtain Positional information and offset information to the terminal in the reality scene, and it is synchronized to server end;
S4:The data syn-chronization of the server end is included in the terminal.
The beneficial effects of the invention are as follows:Positional information and offset information that the technical program passes through the terminal hand-held to user Being tracked and be published to server end carries out data processing and synchronization, is displayed in the terminal of user by rendering engine, from And realize the interaction of the online augmented reality of many people.
On the basis of above-mentioned technical proposal, the present invention can also do following improvement.
Preferably, in the step S3, according to the pixel of the scene image, the terminal is obtained in the reality scene In positional information, the positional information includes the distance between the terminal and scene image information and the terminal Elevation information.
Preferably, in the step S3, according to first three-dimensional coordinate system and second three dimensional space coordinate The vector product of system, obtains offset information of the terminal in the reality scene.
Preferably, the rendering engine is Unity3D rendering engines.
A kind of augmented reality interactive system, the augmented reality interactive system includes:
Rendering module, the scene image of reality scene is obtained for the camera by terminal, according to the scene image The virtual scene corresponding with the reality scene is set up, by rendering engine by the virtual scene display to the terminal On;
Module is set up, for setting up the first three-dimensional coordinate system by origin of the center of the scene image, with described Camera sets up the second three-dimensional coordinate system for origin;
Synchronization module, for according to the scene image, first three-dimensional coordinate system and second three-dimensional space Between coordinate system, obtain positional information and offset information of the terminal in the reality scene, and be synchronized to server end;
Display module, for the data syn-chronization of the server end to be included in the terminal;
Wherein, the rendering module, module, the synchronization module and the display module set up are sequentially connected.
Preferably, in the synchronization module, according to the pixel of the scene image, the terminal is obtained in the real field Positional information in scape, the positional information includes the distance between the terminal and the scene image information and the terminal Elevation information.
Preferably, in the synchronization module, sat according to first three-dimensional coordinate system and second three dimensions The vector product of system is marked, offset information of the terminal in the reality scene is obtained.
Preferably, the rendering engine is Unity3D rendering engines.
Brief description of the drawings
Fig. 1 is a kind of schematic flow sheet of augmented reality exchange method of the invention;
Fig. 2 is a kind of structural representation of augmented reality interactive system of the invention.
Specific embodiment
Principle of the invention and feature are described below in conjunction with accompanying drawing, example is served only for explaining the present invention, and It is non-for limiting the scope of the present invention.
As shown in figure 1, a kind of augmented reality exchange method, augmented reality exchange method includes:
S1:The scene image of reality scene is obtained by the camera of terminal, is set up according to scene image and reality scene Corresponding virtual scene, by rendering engine by virtual scene display in terminal;
S2:The first three-dimensional coordinate system is set up by origin of the center of scene image, is set up by origin of camera Two three-dimensional coordinate systems;
S3:According to scene image, the first three-dimensional coordinate system and the second three-dimensional coordinate system, terminal is obtained in reality Positional information and offset information in scene, and it is synchronized to server end;
S4:The data syn-chronization of server end is included in terminal.
In above-described embodiment, the scene image of reality scene is shot by the camera of terminal (such as mobile phone), set up with The corresponding virtual scene of reality scene, by Unity3D rendering engines by virtual scene display on mobile phone;Respectively with scene Image and camera set up three-dimensional coordinate system for origin, and the vector product according to two three-dimensional coordinate systems obtains mobile phone and exists Offset information in reality scene, according to the pixel of scene image, obtains the distance between mobile phone and scene image information and hand The elevation information of machine, server end is published to by positional information and offset information, and server end carries out database processing and synchronization; Different content is shown on mobile phone according to the data of server end by Unity3D rendering engines.
As shown in Fig. 2 a kind of augmented reality interactive system, augmented reality interactive system includes:
Rendering module 1, the scene image of reality scene is obtained for the camera by terminal, is set up according to scene image The virtual scene corresponding with reality scene, by rendering engine by virtual scene display to terminal;
Module 2 is set up, for setting up the first three-dimensional coordinate system by origin of the center of scene image, is with camera Origin sets up the second three-dimensional coordinate system;
Synchronization module 3, for according to scene image, the first three-dimensional coordinate system and the second three-dimensional coordinate system, obtaining Positional information and offset information to terminal in reality scene, and it is synchronized to server end;
Display module 4, for the data syn-chronization of server end to be included in terminal;
Wherein, rendering module 1, set up module 2, synchronization module 3 and display module 4 and be sequentially connected.
The foregoing is only presently preferred embodiments of the present invention, be not intended to limit the invention, it is all it is of the invention spirit and Within principle, any modification, equivalent substitution and improvements made etc. should be included within the scope of the present invention.

Claims (8)

1. a kind of augmented reality exchange method, it is characterised in that including:
S1:The scene image of reality scene is obtained by the camera of terminal, is set up and the reality according to the scene image The corresponding virtual scene of scene, by rendering engine by the virtual scene display in the terminal;
S2:The first three-dimensional coordinate system is set up by origin of the center of the scene image, is built by origin of the camera Vertical second three-dimensional coordinate system;
S3:According to the scene image, first three-dimensional coordinate system and second three-dimensional coordinate system, institute is obtained Positional information and offset information of the terminal in the reality scene are stated, and is synchronized to server end;
S4:The data syn-chronization of the server end is included in the terminal.
2. augmented reality exchange method according to claim 1, it is characterised in that in the step S3, according to the field The pixel of scape image, obtains positional information of the terminal in the reality scene, and the positional information includes the terminal With the distance between scene image information and the elevation information of the terminal.
3. augmented reality exchange method according to claim 1, it is characterised in that in the step S3, according to described The vector product of one three-dimensional coordinate system and second three-dimensional coordinate system, obtains the terminal in the reality scene Offset information.
4. the augmented reality exchange method according to claim any one of 1-3, it is characterised in that the rendering engine is Unity3D rendering engines.
5. a kind of augmented reality interactive system, it is characterised in that the augmented reality interactive system includes:
Rendering module (1), the scene image of reality scene is obtained for the camera by terminal, is built according to the scene image The vertical virtual scene corresponding with the reality scene, by rendering engine by the virtual scene display to the terminal;
Module (2) is set up, for setting up the first three-dimensional coordinate system by origin of the center of the scene image, is taken the photograph with described As head for origin sets up the second three-dimensional coordinate system;
Synchronization module (3), for according to the scene image, first three-dimensional coordinate system and second three dimensions Coordinate system, obtains positional information and offset information of the terminal in the reality scene, and be synchronized to server end;
Display module (4), for the data syn-chronization of the server end to be included in the terminal;
Wherein, the rendering module (1), described set up module (2), the synchronization module (3) and the display module (4) successively Connection.
6. augmented reality interactive system according to claim 5, it is characterised in that in the synchronization module (3), according to institute The pixel of scene image is stated, positional information of the terminal in the reality scene is obtained, the positional information includes described The elevation information of the distance between terminal and scene image information and the terminal.
7. augmented reality interactive system according to claim 5, it is characterised in that in the synchronization module (3), according to institute The vector product of the first three-dimensional coordinate system and second three-dimensional coordinate system is stated, the terminal is obtained in the real field Offset information in scape.
8. the augmented reality interactive system according to claim any one of 5-7, it is characterised in that the rendering engine is Unity3D rendering engines.
CN201611130384.4A 2016-12-09 2016-12-09 A kind of augmented reality exchange method and system Pending CN106774870A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201611130384.4A CN106774870A (en) 2016-12-09 2016-12-09 A kind of augmented reality exchange method and system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201611130384.4A CN106774870A (en) 2016-12-09 2016-12-09 A kind of augmented reality exchange method and system

Publications (1)

Publication Number Publication Date
CN106774870A true CN106774870A (en) 2017-05-31

Family

ID=58879395

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201611130384.4A Pending CN106774870A (en) 2016-12-09 2016-12-09 A kind of augmented reality exchange method and system

Country Status (1)

Country Link
CN (1) CN106774870A (en)

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107958491A (en) * 2017-12-06 2018-04-24 河南省水利勘测设计研究有限公司 Mobile augmented reality virtual coordinates and construction site coordinate matching method
CN108399638A (en) * 2018-02-08 2018-08-14 重庆爱奇艺智能科技有限公司 A kind of augmented reality exchange method, device and electronic equipment based on label
CN108983974A (en) * 2018-07-03 2018-12-11 百度在线网络技术(北京)有限公司 AR scene process method, apparatus, equipment and computer readable storage medium
CN109901717A (en) * 2019-03-05 2019-06-18 深圳鼎盛乐园娱乐服务有限公司 A kind of virtual reality is raced interactive system more
CN110322484A (en) * 2019-05-29 2019-10-11 武汉幻石佳德数码科技有限公司 The calibration method and system of the augmented reality Virtual Space of more collaborative shares
WO2022126425A1 (en) * 2020-12-16 2022-06-23 深圳晶泰科技有限公司 Experiment observation method and system

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102194248A (en) * 2011-05-05 2011-09-21 上海大学 Method for detecting and responding false-true collision based on augmented reality
CN102395997A (en) * 2009-02-13 2012-03-28 Metaio有限公司 Methods and systems for determining the pose of a camera with respect to at least one object of a real environment
CN102737534A (en) * 2011-04-13 2012-10-17 南京大学 Method for realizing unmarked augmented reality piano teaching system
CN103177468A (en) * 2013-03-29 2013-06-26 渤海大学 Three-dimensional motion object augmented reality registration method based on no marks
CN106101689A (en) * 2016-06-13 2016-11-09 西安电子科技大学 Utilize the method that mobile phone monocular cam carries out augmented reality to virtual reality glasses
JP2017049658A (en) * 2015-08-31 2017-03-09 Kddi株式会社 AR information display device

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102395997A (en) * 2009-02-13 2012-03-28 Metaio有限公司 Methods and systems for determining the pose of a camera with respect to at least one object of a real environment
CN102737534A (en) * 2011-04-13 2012-10-17 南京大学 Method for realizing unmarked augmented reality piano teaching system
CN102194248A (en) * 2011-05-05 2011-09-21 上海大学 Method for detecting and responding false-true collision based on augmented reality
CN103177468A (en) * 2013-03-29 2013-06-26 渤海大学 Three-dimensional motion object augmented reality registration method based on no marks
JP2017049658A (en) * 2015-08-31 2017-03-09 Kddi株式会社 AR information display device
CN106101689A (en) * 2016-06-13 2016-11-09 西安电子科技大学 Utilize the method that mobile phone monocular cam carries out augmented reality to virtual reality glasses

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
熊红艳: "基于标志的增强现实技术的研究", 《中国硕士学位论文全文数据库信息科技辑》 *
范静涛: "《沉浸式投影系统设计技术》", 30 June 2015, 国防工业出版社 *

Cited By (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107958491A (en) * 2017-12-06 2018-04-24 河南省水利勘测设计研究有限公司 Mobile augmented reality virtual coordinates and construction site coordinate matching method
CN107958491B (en) * 2017-12-06 2021-05-14 河南省水利勘测设计研究有限公司 Matching method of mobile augmented reality virtual coordinates and construction site coordinates
CN108399638A (en) * 2018-02-08 2018-08-14 重庆爱奇艺智能科技有限公司 A kind of augmented reality exchange method, device and electronic equipment based on label
CN108399638B (en) * 2018-02-08 2021-07-20 重庆爱奇艺智能科技有限公司 Augmented reality interaction method and device based on mark and electronic equipment
CN108983974A (en) * 2018-07-03 2018-12-11 百度在线网络技术(北京)有限公司 AR scene process method, apparatus, equipment and computer readable storage medium
CN108983974B (en) * 2018-07-03 2020-06-30 百度在线网络技术(北京)有限公司 AR scene processing method, device, equipment and computer-readable storage medium
CN109901717A (en) * 2019-03-05 2019-06-18 深圳鼎盛乐园娱乐服务有限公司 A kind of virtual reality is raced interactive system more
CN110322484A (en) * 2019-05-29 2019-10-11 武汉幻石佳德数码科技有限公司 The calibration method and system of the augmented reality Virtual Space of more collaborative shares
CN110322484B (en) * 2019-05-29 2023-09-08 武汉幻石佳德数码科技有限公司 Calibration method and system for multi-device shared augmented reality virtual space
WO2022126425A1 (en) * 2020-12-16 2022-06-23 深圳晶泰科技有限公司 Experiment observation method and system

Similar Documents

Publication Publication Date Title
CN106774870A (en) A kind of augmented reality exchange method and system
US9595127B2 (en) Three-dimensional collaboration
CN109976519B (en) Interactive display device based on augmented reality and interactive display method thereof
Kato et al. Marker tracking and hmd calibration for a video-based augmented reality conferencing system
US8994780B2 (en) Video conferencing enhanced with 3-D perspective control
JP2022524683A (en) Systems and methods for rendering real-world objects using depth information
EP3834408A1 (en) Gaze-correct video conferencing systems and methods
CN102509349B (en) Fitting method based on mobile terminal, fitting device based on mobile terminal and mobile terminal
US20120162384A1 (en) Three-Dimensional Collaboration
WO2017143303A1 (en) Apparatuses, methods and systems for sharing virtual elements
WO2017161660A1 (en) Augmented reality equipment, system, image processing method and device
US20180218539A1 (en) Rendering emthod in ar scene, processor and ar glasses
US9626564B2 (en) System for enabling eye contact in electronic images
CN205581784U (en) Can mix real platform alternately based on reality scene
WO2014062663A1 (en) System and method for combining data from multiple depth cameras
CN107274491A (en) A kind of spatial manipulation Virtual Realization method of three-dimensional scenic
WO2017204581A1 (en) Virtual reality system using mixed reality, and implementation method therefor
JPWO2017094543A1 (en) Information processing apparatus, information processing system, information processing apparatus control method, and parameter setting method
CN106898049A (en) A kind of spatial match method and system for mixed reality equipment
CN110427227B (en) Virtual scene generation method and device, electronic equipment and storage medium
CN104656893A (en) Remote interaction control system and method for physical information space
CN105278663A (en) Augmented reality house experience system
US10171800B2 (en) Input/output device, input/output program, and input/output method that provide visual recognition of object to add a sense of distance
WO2017061890A1 (en) Wireless full body motion control sensor
CN111459432B (en) Virtual content display method and device, electronic equipment and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20170531

RJ01 Rejection of invention patent application after publication