CN107015642A - A kind of method of data synchronization and system based on augmented reality - Google Patents

A kind of method of data synchronization and system based on augmented reality Download PDF

Info

Publication number
CN107015642A
CN107015642A CN201710146825.8A CN201710146825A CN107015642A CN 107015642 A CN107015642 A CN 107015642A CN 201710146825 A CN201710146825 A CN 201710146825A CN 107015642 A CN107015642 A CN 107015642A
Authority
CN
China
Prior art keywords
virtual scene
camera
client
image
augmented reality
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201710146825.8A
Other languages
Chinese (zh)
Inventor
胡德志
孙碧亮
刘凯能
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Wuhan Bao Bao Software Co Ltd
Original Assignee
Wuhan Bao Bao Software Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Wuhan Bao Bao Software Co Ltd filed Critical Wuhan Bao Bao Software Co Ltd
Priority to CN201710146825.8A priority Critical patent/CN107015642A/en
Publication of CN107015642A publication Critical patent/CN107015642A/en
Pending legal-status Critical Current

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/10Protocols in which an application is distributed across nodes in the network
    • H04L67/1095Replication or mirroring of data, e.g. scheduling or transport for data synchronisation between network nodes
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/50Network services
    • H04L67/52Network services specially adapted for the location of the user terminal

Abstract

The invention discloses a kind of method of data synchronization based on augmented reality and system, method includes:S1, by the camera of client the identification figure in reality scene is scanned;S2, the image for obtaining scanning are matched with the background image in virtual scene, and virtual scene includes the corresponding multiple dummy models of multiple client;S3, after the match is successful, according to the position relationship of the outer ginseng matrix and internal reference matrix and camera of camera and identification figure, obtain positional information of the dummy model in virtual scene;S4, positional information is sent to service end, passes through all clients of the server synchronization into virtual scene.The beneficial effects of the invention are as follows:By augmented reality and camera by the location information synchronizing of client into virtual scene, realize that many personal datas are synchronous, the usage experience good to user.

Description

A kind of method of data synchronization and system based on augmented reality
Technical field
The present invention relates to augmented reality field, more particularly to a kind of method of data synchronization based on augmented reality and it is System.
Background technology
At present, also it is only to use traditional keyboard remote sensing input mode in terms of the interacting of people and virtual game environment Interact, still, such mode can not realize that many personal datas are synchronous, can only carry out unit interaction, greatly reduce use Experience at family.
The content of the invention
The invention provides a kind of method of data synchronization based on augmented reality and system, solving prior art can not be real Now many personal data synchronizations and the poor technical problem of Consumer's Experience.
The technical scheme that the present invention solves above-mentioned technical problem is as follows:A kind of method of data synchronization based on augmented reality, Including:
S1, by the camera of client the identification figure in reality scene is scanned;
S2, the image for obtaining scanning are matched with the background image in virtual scene, and the virtual scene includes many The corresponding multiple dummy models of individual client;
S3, after the match is successful, according to the outer ginseng matrix and internal reference matrix of the camera and the camera and institute The position relationship of identification figure is stated, position letter of the corresponding dummy model of active client in the virtual scene is obtained Breath;
S4, the positional information is sent to service end, owned by the server synchronization into the virtual scene The corresponding client of dummy model.
The beneficial effects of the invention are as follows:Compared to traditional keyboard remote sensing type input method, by augmented reality and The location information synchronizing of client into virtual scene, is realized that many personal datas are synchronous, gives the use body of user well by camera Test.
On the basis of above-mentioned technical proposal, the present invention can also do following improvement.
Preferably, the step S2 is specifically included:The characteristic point in the image for scanning and obtaining is extracted, according to the spy The image for a little obtaining the scanning is levied to be matched with the background image in virtual scene.
Preferably, the step S3 includes:
S31, after the match is successful, according to the outer ginseng matrix and internal reference matrix of the camera and the camera and institute The position relationship of characteristic point is stated, the camera and the relative distance at the identification figure center is calculated;
S32, according to camera imaging principle and the relative distance, obtain the dummy model and the background image Relative position relation;
S33, the position letter according to the relative position relation and the default background image in the virtual scene Breath, obtains positional information of the dummy model in the virtual scene.
A kind of data synchronous system based on augmented reality, including:
Scan module, is scanned for the camera by client to the identification figure in reality scene;
Matching module, is matched for will scan obtained image with the background image in virtual scene, described virtual Scene includes the corresponding multiple dummy models of multiple client;
Acquisition module, for after the match is successful, according to the outer ginseng matrix and internal reference matrix of the camera and described The position relationship of camera and the identification figure, obtains the corresponding dummy model of active client in the virtual scene Positional information;
Synchronization module, for the positional information to be sent into service end, by the server synchronization to described virtual The corresponding client of all dummy models in scene.
Preferably, the matching module is specifically for extracting the characteristic point scanned in obtained image, according to described Characteristic point is matched the image that the scanning is obtained with the background image in virtual scene.
Preferably, the acquisition module includes:
Calculating sub module, for after the match is successful, according to the outer ginseng matrix and internal reference matrix of the camera and institute The position relationship of camera and the characteristic point is stated, the camera and the relative distance at the identification figure center is calculated;
First acquisition submodule, for according to camera imaging principle and the relative distance, obtaining the dummy model With the relative position relation of the background image;
Second acquisition submodule, for according to the relative position relation and the default background image described virtual Positional information in scene, obtains positional information of the dummy model in the virtual scene.
Brief description of the drawings
Fig. 1 is a kind of schematic flow sheet of the method for data synchronization based on augmented reality provided in an embodiment of the present invention;
A kind of flow signal for method of data synchronization based on augmented reality that Fig. 2 provides for another embodiment of the present invention Figure;
A kind of structural representation for data synchronous system based on augmented reality that Fig. 3 provides for another embodiment of the present invention Figure;
A kind of structural representation for data synchronous system based on augmented reality that Fig. 4 provides for another embodiment of the present invention Figure.
Embodiment
The principle and feature of the present invention are described below in conjunction with accompanying drawing, the given examples are served only to explain the present invention, and It is non-to be used to limit the scope of the present invention.
As shown in figure 1, there is provided a kind of method of data synchronization based on augmented reality in embodiment, including:
S1, by the camera of client the identification figure in reality scene is scanned;
S2, the image for obtaining scanning are matched with the background image in virtual scene, and virtual scene includes multiple visitors The corresponding multiple dummy models in family end;
S3, after the match is successful, according to the outer ginseng matrix and internal reference matrix and camera of camera with identification figure position Relation is put, positional information of the dummy model in virtual scene is obtained;
S4, positional information is sent to service end, passes through all clients of the server synchronization into virtual scene.
It should be understood that compared to traditional keyboard remote sensing type input method, by augmented reality and camera by client The location information synchronizing at end realizes that many personal datas are synchronous, the usage experience good to user into virtual scene.
Specifically, step S2 is specifically included:The characteristic point in the image that scanning is obtained is extracted, will be scanned according to characteristic point To image matched with the background image in virtual scene.
Specifically, each client logined successfully can create an Agent virtual objects, Agent in service end By carrying the accounts information of client, the player information and related category in game can be got from Database databases Property, but game logic processing can be carried out in Room, the result and data of processing are issued to each by Internet Client, client, which is received, makes corresponding response after corresponding message.Service end end mainly undertakes following function:Data are deposited Storage and management, including accounts information and game virtual Role Information;The forwarding and utilization of packet, receive the number from client According to bag, used after unserializing.Encapsulated data packet, is issued to client, it is ensured that the real-time and stability of data communication; The maintenance and management of scene of game, according to the quantity of player, it is ensured that Room quantity can be added dynamically at any time;Game logic Processing, including the AI logics in the incoming input information and Game Eccentric Person come of player, AI here refer to non-controlling player Behavior.Such as:Monster in game, it is not controlled by player.But it has factum.These behaviors are each Client is consistent, so AI logics are undertaken by service end, is then uniformly issued to each client.
As shown in Fig. 2 in another embodiment, the step S3 in Fig. 1 includes:
S31, after the match is successful, according to the outer ginseng matrix of camera and the position of internal reference matrix and camera and characteristic point Relation is put, camera and the relative distance at identification figure center is calculated;
S32, according to camera imaging principle and relative distance, the relative position for obtaining dummy model and background image is closed System;
S33, the positional information according to relative position relation and default background image in virtual scene, obtain virtual mould Positional information of the type in virtual scene.
Specifically, the image information and virtual scene collected by image capture device (in particular to mobile phone camera) In identification figure information matched.As long as the match is successful, it is possible to according to image capture device in reality with identification figure away from From relation, the position relationship of identification figure and dummy model in virtual scene is conversed.When client scene construction, we Meeting " preset " identification figure information in scene, includes its position, rotation and scaling.Mobile phone camera passes through to real generation The image information on boundary is identified, and can match the characteristic point information of identification figure in real world, passes through the outer ginseng square of camera Battle array, internal reference matrix and characteristic point and the coordinate relation of camera, can calculate image capture device to the phase at identification figure center Adjust the distance, based on video camera imaging principle, it is known that dummy model and the relative distance y and IMAQ that figure is recognized in virtual scene Proportionate relationship b of the equipment to the relative distance x at identification figure center (different camera ratios is different), it is possible to calculate virtual The relative position relation of identification figure and dummy model in scene, due to recognizing figure position, rotation and scaling etc. in virtual scene all It is known, the relative position relation based on identification figure and dummy model in virtual scene can just calculate dummy model in void Intend the position in scene.When player carries out position movement in reality scene, the model in virtual scene can also be carried out Corresponding evolution, can just hide the attack of monster, this has with traditional input mode when we move left and right Very big difference.The input can be come into the positional information come and carry out data syn-chronization by service end again by us, so that real A kind of existing new internet game experience.
As shown in figure 3, in another embodiment there is provided a kind of data synchronous system based on augmented reality, including:
Scan module 1, is scanned for the camera by client to the identification figure in reality scene;
Matching module 2, is matched, virtual scene for will scan obtained image with the background image in virtual scene Including the corresponding multiple dummy models of multiple client;
Acquisition module 3, for after the match is successful, according to the outer ginseng matrix and internal reference matrix and camera of camera with The position relationship of figure is recognized, positional information of the corresponding dummy model of active client in virtual scene is obtained;
Synchronization module 4, for positional information to be sent into service end, by server synchronization into virtual scene all void The corresponding client of analog model.
Specifically, matching module 2 will be scanned specifically for extracting the characteristic point in the image that scanning is obtained according to characteristic point Obtained image is matched with the background image in virtual scene.
As shown in figure 4, in another embodiment, the acquisition module 3 in Fig. 3 includes:
Calculating sub module 31, for after the match is successful, according to the outer ginseng matrix of camera and internal reference matrix and shooting Head and the position relationship of characteristic point, calculate camera and the relative distance at identification figure center;
First acquisition submodule 32, for according to camera imaging principle and relative distance, obtaining dummy model and background The relative position relation of image;
Second acquisition submodule 33, for the position according to relative position relation and default background image in virtual scene Confidence ceases, and obtains positional information of the dummy model in virtual scene.
The foregoing is only presently preferred embodiments of the present invention, be not intended to limit the invention, it is all the present invention spirit and Within principle, any modification, equivalent substitution and improvements made etc. should be included in the scope of the protection.

Claims (6)

1. a kind of method of data synchronization based on augmented reality, it is characterised in that including:
S1, by the camera of client the identification figure in reality scene is scanned;
S2, the image for obtaining scanning are matched with the background image in virtual scene, and the virtual scene includes multiple visitors The corresponding multiple dummy models in family end;
S3, after the match is successful, known according to the outer ginseng matrix and internal reference matrix of the camera and the camera with described The position relationship of figure, does not obtain positional information of the corresponding dummy model of active client in the virtual scene;
S4, the positional information is sent to service end, by the server synchronization into the virtual scene it is all virtual The corresponding client of model.
2. a kind of method of data synchronization based on augmented reality according to claim 1, it is characterised in that the step S2 Specifically include:The characteristic point in the image for scanning and obtaining is extracted, the image for the scanning being obtained according to the characteristic point Background image in the virtual scene stored with service end is matched.
3. a kind of method of data synchronization based on augmented reality according to claim 2, it is characterised in that the step S3 Including:
S31, after the match is successful, according to the outer ginseng matrix and internal reference matrix of the camera and the camera and the spy Position relationship a little is levied, the camera and the relative distance at the identification figure center is calculated;
S32, according to camera imaging principle and the relative distance, obtain the dummy model relative with the background image Position relationship;
S33, the positional information according to the relative position relation and the default background image in the virtual scene, are obtained Take positional information of the dummy model in the virtual scene.
4. a kind of data synchronous system based on augmented reality, it is characterised in that including:
Scan module, is scanned for the camera by client to the identification figure in reality scene;
Matching module, is matched, the virtual scene for will scan obtained image with the background image in virtual scene Including the corresponding multiple dummy models of multiple client;
Acquisition module, for after the match is successful, according to the outer ginseng matrix and internal reference matrix of the camera and the shooting The position relationship of head and the identification figure, obtains position of the corresponding dummy model of active client in the virtual scene Confidence ceases;
Synchronization module, for the positional information to be sent into service end, passes through the server synchronization to the virtual scene In the corresponding client of all dummy models.
5. a kind of data synchronous system based on augmented reality according to claim 3, it is characterised in that the matching mould Block is specifically for extracting the characteristic point scanned in obtained image, the image for being obtained the scanning according to the characteristic point Background image in the virtual scene stored with service end is matched.
6. a kind of data synchronous system based on augmented reality according to claim 3, it is characterised in that the acquisition mould Block includes:
Calculating sub module, for after the match is successful, according to the outer ginseng matrix and internal reference matrix of the camera and described takes the photograph As head and the position relationship of the characteristic point, the camera and the relative distance at the identification figure center are calculated;
First acquisition submodule, for according to camera imaging principle and the relative distance, obtaining the dummy model and institute State the relative position relation of background image;
Second acquisition submodule, for according to the relative position relation and the default background image in the virtual scene In positional information, obtain the positional information of the dummy model in the virtual scene.
CN201710146825.8A 2017-03-13 2017-03-13 A kind of method of data synchronization and system based on augmented reality Pending CN107015642A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201710146825.8A CN107015642A (en) 2017-03-13 2017-03-13 A kind of method of data synchronization and system based on augmented reality

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201710146825.8A CN107015642A (en) 2017-03-13 2017-03-13 A kind of method of data synchronization and system based on augmented reality

Publications (1)

Publication Number Publication Date
CN107015642A true CN107015642A (en) 2017-08-04

Family

ID=59439708

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201710146825.8A Pending CN107015642A (en) 2017-03-13 2017-03-13 A kind of method of data synchronization and system based on augmented reality

Country Status (1)

Country Link
CN (1) CN107015642A (en)

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107748617A (en) * 2017-10-24 2018-03-02 广州云友网络科技有限公司 A kind of virtual scene method synchronous with body-sensing, sense of touch
CN107952240A (en) * 2017-11-30 2018-04-24 北京奇虎科技有限公司 Game control method, device and the computing device realized using self-shooting bar
CN108871314A (en) * 2018-07-18 2018-11-23 江苏实景信息科技有限公司 A kind of positioning and orientation method and device
CN109634421A (en) * 2018-12-14 2019-04-16 苏州梦想人软件科技有限公司 Space virtual based on augmented reality clicks exchange method
CN110211240A (en) * 2019-05-31 2019-09-06 中北大学 A kind of augmented reality method for exempting from sign-on ID
WO2021047427A1 (en) * 2019-09-10 2021-03-18 中兴通讯股份有限公司 Augmented reality interaction realization method and system, augmented reallity device, and storage medium
CN115016688A (en) * 2022-06-28 2022-09-06 维沃移动通信有限公司 Virtual information display method and device and electronic equipment

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20130201188A1 (en) * 2012-02-06 2013-08-08 Electronics And Telecommunications Research Institute Apparatus and method for generating pre-visualization image
CN104436634A (en) * 2014-11-19 2015-03-25 重庆邮电大学 Real person shooting game system adopting immersion type virtual reality technology and implementation method of real person shooting game system
CN104656893A (en) * 2015-02-06 2015-05-27 西北工业大学 Remote interaction control system and method for physical information space
CN105617658A (en) * 2015-12-25 2016-06-01 新浪网技术(中国)有限公司 Multiplayer moving shooting game system based on real indoor environment
CN106484118A (en) * 2016-10-24 2017-03-08 福建北极光虚拟视觉展示科技有限公司 A kind of augmented reality exchange method based on fixing trigger source and system

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20130201188A1 (en) * 2012-02-06 2013-08-08 Electronics And Telecommunications Research Institute Apparatus and method for generating pre-visualization image
CN104436634A (en) * 2014-11-19 2015-03-25 重庆邮电大学 Real person shooting game system adopting immersion type virtual reality technology and implementation method of real person shooting game system
CN104656893A (en) * 2015-02-06 2015-05-27 西北工业大学 Remote interaction control system and method for physical information space
CN105617658A (en) * 2015-12-25 2016-06-01 新浪网技术(中国)有限公司 Multiplayer moving shooting game system based on real indoor environment
CN106484118A (en) * 2016-10-24 2017-03-08 福建北极光虚拟视觉展示科技有限公司 A kind of augmented reality exchange method based on fixing trigger source and system

Cited By (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107748617A (en) * 2017-10-24 2018-03-02 广州云友网络科技有限公司 A kind of virtual scene method synchronous with body-sensing, sense of touch
CN107952240A (en) * 2017-11-30 2018-04-24 北京奇虎科技有限公司 Game control method, device and the computing device realized using self-shooting bar
CN107952240B (en) * 2017-11-30 2021-01-08 北京奇虎科技有限公司 Game control method and device realized by using selfie stick and computing equipment
CN108871314A (en) * 2018-07-18 2018-11-23 江苏实景信息科技有限公司 A kind of positioning and orientation method and device
CN109634421A (en) * 2018-12-14 2019-04-16 苏州梦想人软件科技有限公司 Space virtual based on augmented reality clicks exchange method
CN110211240A (en) * 2019-05-31 2019-09-06 中北大学 A kind of augmented reality method for exempting from sign-on ID
CN110211240B (en) * 2019-05-31 2022-10-21 中北大学 Registration-free identification augmented reality method
WO2021047427A1 (en) * 2019-09-10 2021-03-18 中兴通讯股份有限公司 Augmented reality interaction realization method and system, augmented reallity device, and storage medium
CN115016688A (en) * 2022-06-28 2022-09-06 维沃移动通信有限公司 Virtual information display method and device and electronic equipment

Similar Documents

Publication Publication Date Title
CN107015642A (en) A kind of method of data synchronization and system based on augmented reality
CN106984043A (en) The method of data synchronization and system of a kind of many people's battle games
CN106815555B (en) Augmented reality method and system for distributed scene target recognition
CN107168532A (en) A kind of virtual synchronous display methods and system based on augmented reality
CN109218619A (en) Image acquiring method, device and system
CN105678702B (en) A kind of the human face image sequence generation method and device of feature based tracking
CN102171726B (en) Information processing device, information processing method, program, and information storage medium
CN107257403A (en) Use the communication of interaction incarnation
CN107170068A (en) Movable attendance checking method based on scene and image recognition
WO2019109828A1 (en) Ar service processing method, device, server, mobile terminal, and storage medium
CN106371603A (en) Position service and augmented reality technology-based role positioning capturing method
CN205754617U (en) A kind of virtual reality touring system
CN103731583A (en) Integrated device for intelligent photograph synthesizing and printing and processing method for intelligent photograph synthesizing and printing
US20090128555A1 (en) System and method for creating and using live three-dimensional avatars and interworld operability
CN110152308A (en) A kind of more personages' group photo methods of game virtual image
CN110286751A (en) A kind of virtual scene digital applications exchange method
CN109078327A (en) Game implementation method and equipment based on AR
CN111582240A (en) Object quantity identification method, device, equipment and medium
KR101197126B1 (en) Augmented reality system and method of a printed matter and video
CN109529350A (en) A kind of action data processing method and its device applied in game
CN109522503A (en) The virtual message board system in tourist attractions based on AR Yu LBS technology
CN108983974A (en) AR scene process method, apparatus, equipment and computer readable storage medium
CN108134945A (en) AR method for processing business, device and terminal
CN109150690A (en) Interaction data processing method, device, computer equipment and storage medium
CN106875478A (en) Experience the AR devices of mobile phone 3D effect

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20170804

RJ01 Rejection of invention patent application after publication