CN102495959A - Augmented reality (AR) platform system based on position mapping and application method - Google Patents

Augmented reality (AR) platform system based on position mapping and application method Download PDF

Info

Publication number
CN102495959A
CN102495959A CN201110397878XA CN201110397878A CN102495959A CN 102495959 A CN102495959 A CN 102495959A CN 201110397878X A CN201110397878X A CN 201110397878XA CN 201110397878 A CN201110397878 A CN 201110397878A CN 102495959 A CN102495959 A CN 102495959A
Authority
CN
China
Prior art keywords
user
data
module
augmented reality
portable equipment
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201110397878XA
Other languages
Chinese (zh)
Inventor
熊永平
马建
刘东辉
宋峥
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
WUXI SMART SENSING STARS TECHNOLOGY Co Ltd
Original Assignee
WUXI SMART SENSING STARS TECHNOLOGY Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by WUXI SMART SENSING STARS TECHNOLOGY Co Ltd filed Critical WUXI SMART SENSING STARS TECHNOLOGY Co Ltd
Priority to CN201110397878XA priority Critical patent/CN102495959A/en
Publication of CN102495959A publication Critical patent/CN102495959A/en
Pending legal-status Critical Current

Links

Abstract

The invention provides an augmented reality (AR) platform system based on position mapping and solves the problem that the conventional mainstream games and analog systems cannot meet a requirement for collaborative operation of multi-user interaction in different physical spaces. Correspondingly, the invention also provides an application method of the AR platform system based on the position mapping. The AR platform system based on the position mapping comprises a management server and at least one set of user portable equipment, wherein the user portable equipment comprises a control module, a positioning and auxiliary sensor module, an AR module and a network transmission module; the control module is in internet connection with the management server through the network transmission module; data communication between the positioning and auxiliary sensor module and the control module is realized through a wireless network; and the AR module and the control module are connected in a wireless mode or in a wired mode. The application method of the AR platform system based on the position mapping comprises the following steps of: (1) constructing a target scene; (2) mapping an initial position; (3) acquiring user sensor data; (4) updating user state; (5) updating the target scene; (6) performing interactive calculation; and (7) performing AR feedback.

Description

A kind of augmented reality plateform system and application process of position-based mapping
Technical field
The present invention relates to augmented reality, location and field of sensing technologies, be specially a kind of augmented reality plateform system and application process of position-based mapping.
Background technology
Now main flow recreation and simulation system mainly all are based on the desktop virtual reality.Though along with the development of image technique, desktop can present picture more true to nature, the user still need be sitting in face of the computer, and only limits to carry out with equipment such as mouse, keyboard and virtual scene or other user limited mutual.This type systematic has not been used the person on user experience satisfies.Therefore immerse fully a kind of, how mutual the demand that has more recreation such as vision, the sense of hearing, sense of touch or simulation system be just more and more stronger.Augmented reality technology particularly cooperating type augmented reality technology provides possibility for the realization of this system.
Augmented reality (Augmented Reality is called for short AR) also is referred to as mixed reality, is one of research focus of external in recent years numerous well-known universities and research institution.It passes through computer technology; Virtual information is applied to real world; Be added in real time same picture or space of real environment and virtual object exists simultaneously and realized virtual information to the replenishing of real world information, stack, and its main application fields comprises medical research and dissects training, exact instrument manufacturing and maintenance, military aircraft navigation, engineering design and tele-robotic control etc.Augmented reality mainly is used for strengthening the effect of sense organ aspect such as user's vision, the sense of hearing, sense of touch, is replenishing and expansion the actual environment real information.The researchist of Canada McGill University (McGill University) develops a kind of floor tile system that imitates sand ground, snowfield, meadow environment; This system is by a series of sensors, projection, loudspeaker and can shake plate and form; Wherein, Sensor is used to receive user profile, projection, loudspeaker, can shake plate and then is respectively applied for and strengthens user's feedback aspect vision, the sense of hearing, sense of touch when stepping into varying environment.Augmented reality system such as above-mentioned combination vision, the sense of hearing, sense of touch can be brought more rich experience to the user, but can not satisfy the requirement of collaborative work and amusement.Because the fast development of internet, augmented reality and network technology combine to become possibility, in fact, the cooperating type augmented reality is exactly that one of them typical case represents.
Cooperating type augmented reality technology (Collaborative Augmented Reality; Be called for short CAR) be the combination of augmented reality technology and network technology; It is the important component part of augmented reality technology; It can make a plurality of users experience the augmented reality scene that virtual objects and true environment combine together simultaneously, and can on network communication platform, carry out various interactive operations and collaborative work, accomplishes preplanned mission jointly.The augmented reality air hockey system (AR2 Hockey) of people's research and development such as the at present existing Japanese augmented reality system laboratory Toshikazu Ohshima of cooperating type augmented reality technology, Kiyohide Satoh.This system adopts based on the nothing of user's relative position and repels mutual dynamic registration method; Two players can realize a hockey tournament through physics sports ground, mallet and the virtual hockey of sharing; Yet; Be subject to simple registration algorithm, the defective of its existence is that the participant of system need be in same true environment, and carry out crew-served user simultaneously can not be more than two people.This shows that cooperating type augmented reality technology, particularly interactive stronger distributed collaborative formula augmented reality technology are in real time, location registers has higher requirements accurately.
Therefore, present cooperating type augmented reality technology still can not satisfy the co-operating requirement of the multiusers interaction that is in different physical spaces, thereby can't solve the problem that existing main flow is played and the user-interaction experience of simulation system existence can not meet the demands.
Summary of the invention
To the problems referred to above, the invention provides the augmented reality plateform system of a kind of position-based mapping, it can solve existing main flow recreation and simulation system can not satisfy the problem that the co-operating of the multiusers interaction that is in different physical spaces requires.For this reason, the present invention also provides the application process of the augmented reality plateform system of position-based mapping.
A kind of augmented reality plateform system of position-based mapping; It is characterized in that: it comprises management server and at least one cover user portable equipment; Said user's portable equipment comprises control module, location and aiding sensors module, augmented reality (AR) module and network transmission module; Said control module is carried out Internet through said network transmission module and said management server and is connected; Carry out communicating by letter of data through wireless network between said location and aiding sensors module and the said control module, said augmented reality (AR) module and said control module are through wireless or wired connection.
It is further characterized in that: said management server comprises Foreground Data interactive server and data computation storage server; Said Foreground Data interactive server is responsible for receiving the data of the sensor senses such as customer location that said user's portable equipment reports, and to user's portable equipment control data is provided; Said data computation storage server be responsible for storing with management objectives scene state and object scene in all users' state; Said control module is that wearable computer or other satisfy the minitype portable computer of processing power; Like the Wristwatch-type computer; Highly intelligentized mobile phone; PDA etc., it mainly be responsible for to gather location and aiding sensors module data, like customer location and sight line etc., through said network transmission module and management server communication, control the input of said augmented reality module data; Said location and aiding sensors module comprise three-dimensional localization equipment, user's sight line collecting device, voice capture device; The integrated positioning chip commonly used of said positioning equipment is included in the chip of GPS positioning chip that uses when outdoor and integrated WiFi, RFID and the inertial sensor that in indoor environment, uses; Said user's sight line collecting device is that the inner three-dimensional compass of user's Helmet Mounted Display is realized; Said voice capture device is a mini microphone; Said augmented reality module comprises optical perspective formula three-dimensional helmet display, data glove, the small-sized audio amplifier that has the eye tracking function; Said Helmet Mounted Display is used for to the user visual feedback being provided; Said data glove is used for to the user tactile feedback being provided, and said small-sized audio amplifier is used for to the user audio feedback being provided; Said network transmission module adopts Cellular Networks or wireless local net mode to communicate by letter with Control Server.
A kind of application process of augmented reality plateform system of position-based mapping, it is characterized in that: it may further comprise the steps:
(1) object scene makes up: through the three-dimensional model of modeling software establishing target scene, in the data computation storage server, generate the initialization data of object scene three-dimensional model;
(2) initial position mapping: the user adopts the mode of manual input perhaps to obtain the topology information of user's real physical space of living in through location in user's portable equipment and aiding sensors module; This topology information is transferred to the Foreground Data interactive server through wireless communication module, the employing communication of user's portable equipment; The user profile initialization User Status data that the data computation storage server transmits according to the Foreground Data interactive server; Wherein the User Status data comprise active user's quantity, the user initial position in object scene, the user's person model in the object scene; The Foreground Data interactive server provides control data according to initialization User Status data to user's portable equipment, and the Helmet Mounted Display of user's portable equipment presents the initialization object scene;
(3) user sensor data acquisition: the location goes out the relative position variation of user in the scene of source with the three-dimensional localization calculation of equipments of auxiliary sensing module; Gather user speech, the inner three-dimensional compass collection user sight angle variation of user's Helmet Mounted Display through mini microphone; And send User Status data such as above-mentioned change in location data, speech data and sight angle delta data to control module, give Foreground Data interactive server through network transmission module with above-mentioned User Status data upload by control module;
(4) User Status is upgraded: the User Status data in the step (3) that data computation storage server reception Foreground Data interactive server is uploaded, and above-mentioned User Status data in the calculating storage server that Updates Information;
(5) object scene is upgraded: the data computation storage server upgrades the object scene data according to the User Status data of upgrading in the step (4);
(6) mutual calculating: the data computation storage server is according to the object scene after upgrading; According to the position topological relation between each user and user's sight line data; Calculate the augmented reality feedback that each user's portable equipment should offer the user, as sound, user three-dimensional data, the user's tactile feedback data that should see;
(7) augmented reality feedback: the Foreground Data interactive server is paid control module with the augmented reality data feedback control through the network transmission module of each targeted customer's portable equipment; Control module is according to data feedback control; Augmented reality module in the control portable equipment such as data gloves, audio amplifier, Helmet Mounted Display provide sense of touch, sound, visual augmented reality feedback to the user.
The augmented reality plateform system of position-based mapping of the present invention is applied to recreation or the simulation systems of handing over the family more; Its beneficial effect is: it uses the augmented reality technology; The user that will be in different physical spaces according to the position relation is mapped in the same object scene; Can the how mutual experience of immersing fully, have vision, the sense of hearing, sense of touch be provided to the user, thereby satisfy experience requirements of users.
Description of drawings
Fig. 1 is that interior each module of the augmented reality plateform system of a kind of position-based mapping of the present invention connects synoptic diagram;
Fig. 2 is system's pie graph of the augmented reality plateform system of a kind of position-based mapping of the present invention;
Fig. 3 is the operational flow diagram of the augmented reality plateform system of a kind of position-based mapping of the present invention.
Embodiment
See Fig. 1 and Fig. 2; A kind of augmented reality plateform system of position-based mapping; It comprises management server 1 and at least one cover user portable equipment; User's portable equipment comprises control module 4, location and aiding sensors module 5, augmented reality (AR) module 3 and network transmission module 2; Control module 4 is carried out Internet through network transmission module 2 and management server 1 and is communicated by letter and be connected, and carries out communicating by letter of data through wireless network between location and aiding sensors module 5 and the control module 4, and augmented reality (AR) module 3 and control module 4 are through wireless or wired connection.Management server 1 comprises Foreground Data interactive server and data computation storage server; The Foreground Data interactive server is responsible for receiving the sensing datas such as customer location that user's portable equipment reports, and to user's portable equipment control data is provided; The data computation storage server be responsible for storing with management objectives scene state and mapping scene in all users' state; Control module 4 satisfies the minitype portable computer of processing power for wearable computer or other; Like the Wristwatch-type computer; Highly intelligentized mobile phone; PDA etc., it mainly be responsible for to gather location and aiding sensors module data, as customer location and sight line etc., through network transmission module with management server communication, control the input of augmented reality module data; The location comprises that with aiding sensors module 5 three-dimensional localization equipment, user's sight line are gathered, voice capture device; The integrated positioning chip commonly used of positioning equipment is included in the chip of GPS positioning chip that uses when outdoor and integrated WiFi, RFID and the inertial sensor that in indoor environment, uses; User's sight line is gathered by the three-dimensional compass of user's helmet and is realized; Voice capture device is a mini microphone; Augmented reality module 3 comprises optical perspective formula three-dimensional helmet display, data glove, the small-sized audio amplifier that has the eye tracking function; Helmet Mounted Display is used for to the user visual feedback being provided; Data glove is used for to the user tactile feedback being provided, and small-sized audio amplifier is used for to the user audio feedback being provided; Said network transmission module adopts Cellular Networks or wireless local net mode to communicate by letter with management server 1.
The present invention is a kind of application process of augmented reality plateform system of position-based mapping: it may further comprise the steps, and sees Fig. 3:
(1) object scene makes up: through the three-dimensional model of modeling software establishing target scene, in the data computation storage server, generate the initialization data of object scene three-dimensional model;
(2) initial position mapping: the user adopts the mode of manual input perhaps to obtain the topology information of user's real physical space of living in through location in user's portable equipment and aiding sensors module; This topology information is transferred to the Foreground Data interactive server through wireless communication module, the employing communication of user's portable equipment; The user profile initialization User Status data that the data computation storage server transmits according to the Foreground Data interactive server; Wherein the User Status data comprise active user's quantity, the user initial position in object scene, the user's person model in the object scene; The Foreground Data interactive server provides control data according to initialization User Status data to user's portable equipment, and the Helmet Mounted Display of user's portable equipment presents the initialization object scene;
(3) user sensor data acquisition: the location goes out the relative position variation of user in the scene of source with the three-dimensional localization calculation of equipments of aiding sensors module; Gather user speech, the inner three-dimensional compass collection user sight angle variation of user's Helmet Mounted Display through mini microphone; And send User Status data such as above-mentioned change in location data, speech data and sight angle delta data to control module, give data interaction server through network transmission module with above-mentioned User Status data upload by control module;
(4) User Status is upgraded: the User Status data in the step (3) that data computation storage server reception data interaction server is uploaded, and above-mentioned User Status data in the calculating storage server that Updates Information;
(5) object scene is upgraded: the data computation storage server upgrades the object scene data according to the User Status data of upgrading in the step (4);
(6) mutual calculating: the data computation storage server is according to the object scene after upgrading; According to the position topological relation between each user and user's sight line data; Calculate the augmented reality feedback that each user's portable equipment should offer the user, as sound, user three-dimensional data, the user's tactile feedback data that should see;
(7) augmented reality feedback: the data interaction server is paid control module with the augmented reality data feedback control through the network transmission module of each targeted customer's portable equipment; Control module is according to data feedback control; Augmented reality module in the control portable equipment such as data gloves, audio amplifier, Helmet Mounted Display provide sense of touch, sound, visual augmented reality feedback to the user.
Be example to make up virtual maze game below, the present invention specifically described:
Virtual maze game platform; It comprises management server and user's convenience devices; Wherein management server comprises Foreground Data interactive server and data computation storage server; User's portable equipment comprises control module, location and aiding sensors module, augmented reality (AR) module and network transmission module; Wherein control module is the Wearable computer, location and aiding sensors module the be integrated running fix equipment of acceleration transducer, the three-dimensional electronic compass that is integrated in Helmet Mounted Display and microphone, and augmented reality (AR) module is Helmet Mounted Display, portable small-sized audio amplifier; Network transmission module is a wireless network card, and it is integrated in the Wearable computer;
Specifically describe the structure and the operational process of virtual maze game platform below:
(1) labyrinth makes up: make up virtual three-dimensional labyrinth map through 3DMax, in the data computation storage server, generate the initialization data of virtual three-dimensional labyrinth map, and three-dimensional labyrinth map is loaded into each player's Wearable computer;
(2) initial position mapping: the player selects a big and spacious room; Be with Helmet Mounted Display; Open system, the topology information (, wide etc.) in input room like length; Or manually choose the initial mapping position, the topology information of each player's input information and its real world of living in of getting access to through location and aiding sensors module is transferred to the Foreground Data interactive server through communication; The player information initialization User Status data that the data computation storage server transmits according to the Foreground Data interactive server, wherein the User Status data comprise number of players, the player state at object space; The Foreground Data interactive server provides control data according to initialization User Status data to player's portable equipment, and Helmet Mounted Display will present the scene of labyrinth map and room stack, just as the player really in the relevant position in labyrinth;
(3) player's sensor data acquisition: each player has carried the running fix equipment of acceleration transducer integrated; When mobile; Positioning software on the running fix equipment calculates relative displacement through acceleration transducer; The integrated three-dimensional electronic compass of Helmet Mounted Display that the player wore simultaneously calculates player's sight angle to be changed; User Status data such as relative displacement data, sight angle variation are transferred to the Wearable computer through communication, and give the Foreground Data interactive server through the Wearable computer with User Status data transmission such as relative displacement, visual angle change;
(4) player status upgrades: the User Status data that the data computation storage server receives and the interactive server that Updates Information is uploaded;
(5) three-dimensional labyrinth is upgraded: the data computation storage server is according to the three-dimensional labyrinth of the User Status Data Update of having upgraded data;
(6) mutual calculating: the data computation storage server is according to the three-dimensional labyrinth after upgrading; According to the position topological relation between each player and player's sight line data; Calculate the augmented reality feedback that each user's portable equipment should offer the player, comprise other players' that three-dimensional labyrinth map that player institute should see and distance to a declared goal scope are interior speech data;
(7) augmented reality feedback: the data interaction server is paid control module with the augmented reality data feedback control through the network transmission module of each player's portable equipment; Control module is according to data feedback control; The control Helmet Mounted Display provides the current three-dimensional labyrinth map that should appear to the player, other players of control audio amplifier in the player provides the distance to a declared goal scope voice.

Claims (7)

1. the augmented reality plateform system of position-based mapping; It is characterized in that: it comprises management server and at least one cover user portable equipment; Said user's portable equipment comprises control module, location and aiding sensors module, augmented reality (AR) module and network transmission module; Said control module is carried out Internet through said network transmission module and said management server and is connected; Carry out communicating by letter of data through wireless network between said location and aiding sensors module and the said control module, said augmented reality (AR) module and said control module are through wireless or wired connection.
2. the augmented reality plateform system of a kind of position-based mapping according to claim 1, it is characterized in that: said management server comprises Foreground Data interactive server and data computation storage server; Said Foreground Data interactive server is responsible for receiving the data of the sensor senses such as customer location that said user's portable equipment reports, and to user's portable equipment control data is provided; Said data computation storage server be responsible for storing with management objectives scene state and object scene in all users' state.
3. the augmented reality plateform system of a kind of position-based mapping according to claim 2; It is characterized in that: said control module is that wearable computer or other satisfy the minitype portable computer of processing power, and it mainly is responsible for gathering location and aiding sensors module data.
4. the augmented reality plateform system of a kind of position-based mapping according to claim 3, it is characterized in that: said location and aiding sensors module comprise three-dimensional localization equipment, user's sight line collecting device, voice capture device; The integrated positioning chip commonly used of said positioning equipment is included in the chip of GPS positioning chip that uses when outdoor and integrated WiFi, RFID and the inertial sensor that in indoor environment, uses; Said user's sight line collecting device is that the inner three-dimensional compass of user's Helmet Mounted Display is realized; Said voice capture device is a mini microphone.
5. the augmented reality plateform system of a kind of position-based mapping according to claim 4; It is characterized in that: said augmented reality module comprises optical perspective formula three-dimensional helmet display, data glove, the small-sized audio amplifier that has the eye tracking function; Said Helmet Mounted Display is used for to the user visual feedback being provided; Said data glove is used for to the user tactile feedback being provided, and said small-sized audio amplifier is used for to the user audio feedback being provided.
6. the augmented reality plateform system of a kind of position-based mapping according to claim 5 is characterized in that: said network transmission module adopts Cellular Networks or wireless local net mode to communicate by letter with Control Server.
7. the application process of the augmented reality plateform system of position-based mapping, it is characterized in that: it may further comprise the steps:
(1) object scene makes up: through the three-dimensional model of modeling software establishing target scene, in the data computation storage server, generate the initialization data of object scene three-dimensional model;
(2) initial position mapping: the user adopts the mode of manual input perhaps to obtain the topology information of user's real physical space of living in through location in user's portable equipment and aiding sensors module; This topology information is transferred to the Foreground Data interactive server through wireless communication module, the employing communication of user's portable equipment; The user profile initialization User Status data that the data computation storage server transmits according to the Foreground Data interactive server; Wherein the User Status data comprise active user's quantity, the user initial position in object scene, the user's person model in the object scene; The Foreground Data interactive server provides control data according to initialization User Status data to user's portable equipment, and the Helmet Mounted Display of user's portable equipment presents the initialization object scene;
(3) user sensor data acquisition: the location goes out the relative position variation of user in the scene of source with the three-dimensional localization calculation of equipments of auxiliary sensing module; Gather user speech, the inner three-dimensional compass collection user sight angle variation of user's Helmet Mounted Display through mini microphone; And send User Status data such as above-mentioned change in location data, speech data and sight angle delta data to control module, give Foreground Data interactive server through network transmission module with above-mentioned User Status data upload by control module;
(4) User Status is upgraded: the User Status data in the step (3) that data computation storage server reception Foreground Data interactive server is uploaded, and above-mentioned User Status data in the calculating storage server that Updates Information;
(5) object scene is upgraded: the data computation storage server upgrades the object scene data according to the User Status data of upgrading in the step (4);
(6) mutual calculating: the data computation storage server is according to the object scene after upgrading; According to the position topological relation between each user and user's sight line data; Calculate the augmented reality feedback that each user's portable equipment should offer the user, as sound, user three-dimensional data, the user's tactile feedback data that should see;
(7) augmented reality feedback: the Foreground Data interactive server is paid control module with the augmented reality data feedback control through the network transmission module of each targeted customer's portable equipment; Control module is according to data feedback control; Augmented reality module in the control portable equipment such as data gloves, audio amplifier, Helmet Mounted Display provide sense of touch, sound, visual augmented reality feedback to the user.
CN201110397878XA 2011-12-05 2011-12-05 Augmented reality (AR) platform system based on position mapping and application method Pending CN102495959A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201110397878XA CN102495959A (en) 2011-12-05 2011-12-05 Augmented reality (AR) platform system based on position mapping and application method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201110397878XA CN102495959A (en) 2011-12-05 2011-12-05 Augmented reality (AR) platform system based on position mapping and application method

Publications (1)

Publication Number Publication Date
CN102495959A true CN102495959A (en) 2012-06-13

Family

ID=46187784

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201110397878XA Pending CN102495959A (en) 2011-12-05 2011-12-05 Augmented reality (AR) platform system based on position mapping and application method

Country Status (1)

Country Link
CN (1) CN102495959A (en)

Cited By (44)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102801788A (en) * 2012-07-17 2012-11-28 中兴通讯股份有限公司 Method, device and system for realizing augmented reality information sharing
CN103105993A (en) * 2013-01-25 2013-05-15 腾讯科技(深圳)有限公司 Method and system for realizing interaction based on augmented reality technology
CN103810353A (en) * 2014-03-09 2014-05-21 杨智 Real scene mapping system and method in virtual reality
WO2014162257A2 (en) * 2013-04-05 2014-10-09 Zhou Dylan Wearable personal mini cloud game and multimedia device
CN104471639A (en) * 2012-07-20 2015-03-25 微软公司 Voice and gesture identification reinforcement
CN104484033A (en) * 2014-11-21 2015-04-01 上海同筑信息科技有限公司 BIM based virtual reality displaying method and system
CN104537401A (en) * 2014-12-19 2015-04-22 南京大学 Reality augmentation system and working method based on technologies of radio frequency identification and depth of field sensor
CN105190704A (en) * 2013-05-09 2015-12-23 三星电子株式会社 Method and apparatus for providing contents including augmented reality information
CN105323252A (en) * 2015-11-16 2016-02-10 上海璟世数字科技有限公司 Method and system for realizing interaction based on augmented reality technology and terminal
CN105404231A (en) * 2016-01-12 2016-03-16 西北工业大学 Internet of things-based intelligent building monitoring managing system
CN105450736A (en) * 2015-11-12 2016-03-30 小米科技有限责任公司 Method and device for establishing connection with virtual reality
CN105700684A (en) * 2016-01-12 2016-06-22 深圳多哚新技术有限责任公司 Sensor data interrupt processing method and device of head display device
CN105929959A (en) * 2016-04-29 2016-09-07 四川数字工匠科技有限公司 Virtual reality helmet positioning control system
CN105988565A (en) * 2014-11-05 2016-10-05 电子部品研究院 Wearable device and method for extending function of wearable device
CN105989132A (en) * 2015-02-17 2016-10-05 上海触趣网络科技有限公司 Image file processing and speech controlling method
CN106327585A (en) * 2016-08-29 2017-01-11 安徽美图信息科技有限公司 Three-dimensional terrain construction and roaming system based on combination of Html5 and hotspot technology
CN106340063A (en) * 2015-10-21 2017-01-18 北京智谷睿拓技术服务有限公司 Sharing method and sharing device
CN106371585A (en) * 2016-08-23 2017-02-01 塔普翊海(上海)智能科技有限公司 Augmented reality system and method
CN106657060A (en) * 2016-12-21 2017-05-10 惠州Tcl移动通信有限公司 VR communication method and system based on reality scene
CN106802712A (en) * 2015-11-26 2017-06-06 英业达科技有限公司 Interactive augmented reality system
CN106899599A (en) * 2017-03-09 2017-06-27 华东师范大学 A kind of industrial environment outdoor scene enhanced exchange method
CN107168537A (en) * 2017-05-19 2017-09-15 山东万腾电子科技有限公司 A kind of wearable task instruction method and system of collaborative augmented reality
EP3220233A1 (en) * 2016-03-18 2017-09-20 Volvo Car Corporation Method and system for enabling interaction in a test environment
CN107291999A (en) * 2017-06-01 2017-10-24 中国农业大学 A kind of farming analogy method and system based on virtual reality technology
CN107817799A (en) * 2017-11-03 2018-03-20 北京光年无限科技有限公司 The method and system of intelligent interaction are carried out with reference to virtual maze
CN108055390A (en) * 2017-11-22 2018-05-18 吴东辉 Determine that its client corresponds to the AR method and systems of id based on mobile phone screen color
CN108108410A (en) * 2017-12-12 2018-06-01 苏州蜗牛数字科技股份有限公司 A kind of online game labyrinth ground drawing generating method
WO2018121684A1 (en) * 2016-12-29 2018-07-05 中兴通讯股份有限公司 Head-mounted apparatus, interactive game platform, board game implementation system and method
CN108255291A (en) * 2017-12-05 2018-07-06 腾讯科技(深圳)有限公司 Transmission method, device, storage medium and the electronic device of virtual scene data
CN108572722A (en) * 2017-03-07 2018-09-25 松下航空电子公司 System and method for supporting augmented reality application on transport vehicle
CN108830944A (en) * 2018-07-12 2018-11-16 北京理工大学 Optical perspective formula three-dimensional near-eye display system and display methods
CN110083235A (en) * 2019-04-08 2019-08-02 聚好看科技股份有限公司 Interactive system and data processing method
CN110083227A (en) * 2013-06-07 2019-08-02 索尼互动娱乐美国有限责任公司 The system and method for enhancing virtual reality scenario are generated in head-mounted system
CN110199525A (en) * 2017-01-18 2019-09-03 Pcms控股公司 For selecting scene with the system and method for the browsing history in augmented reality interface
CN110301013A (en) * 2017-01-17 2019-10-01 皇家飞利浦有限公司 Augmented reality for the predictive workflow in operating room
US10467814B2 (en) 2016-06-10 2019-11-05 Dirtt Environmental Solutions, Ltd. Mixed-reality architectural design environment
CN110448892A (en) * 2019-07-18 2019-11-15 江西中业光文化科技有限公司 Game implementation method and system based on augmented reality
CN110908504A (en) * 2019-10-10 2020-03-24 浙江大学 Augmented reality museum cooperative interaction method and system based on user-exhibit distance
CN111078015A (en) * 2013-03-15 2020-04-28 意美森公司 Wearable haptic device
US10699484B2 (en) 2016-06-10 2020-06-30 Dirtt Environmental Solutions, Ltd. Mixed-reality and CAD architectural design environment
US10783284B2 (en) 2014-10-15 2020-09-22 Dirtt Environmental Solutions, Ltd. Virtual reality immersion with an architectural design software application
CN111862348A (en) * 2020-07-30 2020-10-30 腾讯科技(深圳)有限公司 Video display method, video generation method, video display device, video generation device, video display equipment and storage medium
CN112102677A (en) * 2020-09-17 2020-12-18 中国人民解放军陆军军医大学 Mixed reality high-simulation battle site emergency training platform and training method thereof
CN111862348B (en) * 2020-07-30 2024-04-30 深圳市腾讯计算机系统有限公司 Video display method, video generation method, device, equipment and storage medium

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101893935A (en) * 2010-07-14 2010-11-24 北京航空航天大学 Cooperative construction method for enhancing realistic table-tennis system based on real rackets
WO2011109126A1 (en) * 2010-03-05 2011-09-09 Sony Computer Entertainment America Llc Maintaining multiple views on a shared stable virtual space

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2011109126A1 (en) * 2010-03-05 2011-09-09 Sony Computer Entertainment America Llc Maintaining multiple views on a shared stable virtual space
CN101893935A (en) * 2010-07-14 2010-11-24 北京航空航天大学 Cooperative construction method for enhancing realistic table-tennis system based on real rackets

Cited By (68)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2014012444A1 (en) * 2012-07-17 2014-01-23 中兴通讯股份有限公司 Method, device and system for realizing augmented reality information sharing
CN102801788A (en) * 2012-07-17 2012-11-28 中兴通讯股份有限公司 Method, device and system for realizing augmented reality information sharing
CN104471639A (en) * 2012-07-20 2015-03-25 微软公司 Voice and gesture identification reinforcement
CN103105993A (en) * 2013-01-25 2013-05-15 腾讯科技(深圳)有限公司 Method and system for realizing interaction based on augmented reality technology
US10049494B2 (en) 2013-01-25 2018-08-14 Tencent Technology (Shenzhen) Company Limited Method and system for performing interaction based on augmented reality
CN103105993B (en) * 2013-01-25 2015-05-20 腾讯科技(深圳)有限公司 Method and system for realizing interaction based on augmented reality technology
CN111078015A (en) * 2013-03-15 2020-04-28 意美森公司 Wearable haptic device
WO2014162257A2 (en) * 2013-04-05 2014-10-09 Zhou Dylan Wearable personal mini cloud game and multimedia device
WO2014162257A3 (en) * 2013-04-05 2015-02-05 Zhou Dylan Wearable personal mini cloud game and multimedia device
US9710970B2 (en) 2013-05-09 2017-07-18 Samsung Electronics Co., Ltd. Method and apparatus for providing contents including augmented reality information
CN105190704B (en) * 2013-05-09 2018-12-07 三星电子株式会社 For providing the method and apparatus of the content including augmented reality information
CN105190704A (en) * 2013-05-09 2015-12-23 三星电子株式会社 Method and apparatus for providing contents including augmented reality information
CN110083227B (en) * 2013-06-07 2022-08-23 索尼互动娱乐美国有限责任公司 System and method for generating augmented virtual reality scenes within a head-mounted system
CN110083227A (en) * 2013-06-07 2019-08-02 索尼互动娱乐美国有限责任公司 The system and method for enhancing virtual reality scenario are generated in head-mounted system
CN103810353A (en) * 2014-03-09 2014-05-21 杨智 Real scene mapping system and method in virtual reality
US11531791B2 (en) 2014-10-15 2022-12-20 Dirtt Environmental Solutions Ltd. Virtual reality immersion with an architectural design software application
US10783284B2 (en) 2014-10-15 2020-09-22 Dirtt Environmental Solutions, Ltd. Virtual reality immersion with an architectural design software application
CN105988565A (en) * 2014-11-05 2016-10-05 电子部品研究院 Wearable device and method for extending function of wearable device
CN104484033B (en) * 2014-11-21 2017-10-03 上海同筑信息科技有限公司 Virtual reality display method and system based on BIM
CN104484033A (en) * 2014-11-21 2015-04-01 上海同筑信息科技有限公司 BIM based virtual reality displaying method and system
CN104537401B (en) * 2014-12-19 2017-05-17 南京大学 Reality augmentation system and working method based on technologies of radio frequency identification and depth of field sensor
CN104537401A (en) * 2014-12-19 2015-04-22 南京大学 Reality augmentation system and working method based on technologies of radio frequency identification and depth of field sensor
CN105989132A (en) * 2015-02-17 2016-10-05 上海触趣网络科技有限公司 Image file processing and speech controlling method
CN106340063B (en) * 2015-10-21 2019-04-12 北京智谷睿拓技术服务有限公司 Sharing method and sharing means
CN106340063A (en) * 2015-10-21 2017-01-18 北京智谷睿拓技术服务有限公司 Sharing method and sharing device
US10534171B2 (en) 2015-10-21 2020-01-14 Beijing Zhigu Rui Tuo Tech Co., Ltd. Sharing method and sharing device
CN105450736B (en) * 2015-11-12 2020-03-17 小米科技有限责任公司 Method and device for connecting with virtual reality
CN105450736A (en) * 2015-11-12 2016-03-30 小米科技有限责任公司 Method and device for establishing connection with virtual reality
CN105323252A (en) * 2015-11-16 2016-02-10 上海璟世数字科技有限公司 Method and system for realizing interaction based on augmented reality technology and terminal
CN106802712A (en) * 2015-11-26 2017-06-06 英业达科技有限公司 Interactive augmented reality system
CN105404231B (en) * 2016-01-12 2018-08-14 西北工业大学 A kind of intelligent building monitoring management system based on Internet of Things
CN105404231A (en) * 2016-01-12 2016-03-16 西北工业大学 Internet of things-based intelligent building monitoring managing system
CN105700684A (en) * 2016-01-12 2016-06-22 深圳多哚新技术有限责任公司 Sensor data interrupt processing method and device of head display device
CN107199966A (en) * 2016-03-18 2017-09-26 沃尔沃汽车公司 Being capable of interactive method and system under the test environment
EP3220233A1 (en) * 2016-03-18 2017-09-20 Volvo Car Corporation Method and system for enabling interaction in a test environment
US10444826B2 (en) 2016-03-18 2019-10-15 Volvo Car Corporation Method and system for enabling interaction in a test environment
CN105929959A (en) * 2016-04-29 2016-09-07 四川数字工匠科技有限公司 Virtual reality helmet positioning control system
US10467814B2 (en) 2016-06-10 2019-11-05 Dirtt Environmental Solutions, Ltd. Mixed-reality architectural design environment
US10699484B2 (en) 2016-06-10 2020-06-30 Dirtt Environmental Solutions, Ltd. Mixed-reality and CAD architectural design environment
US11270514B2 (en) 2016-06-10 2022-03-08 Dirtt Environmental Solutions Ltd. Mixed-reality and CAD architectural design environment
CN106371585A (en) * 2016-08-23 2017-02-01 塔普翊海(上海)智能科技有限公司 Augmented reality system and method
CN106327585A (en) * 2016-08-29 2017-01-11 安徽美图信息科技有限公司 Three-dimensional terrain construction and roaming system based on combination of Html5 and hotspot technology
CN106657060A (en) * 2016-12-21 2017-05-10 惠州Tcl移动通信有限公司 VR communication method and system based on reality scene
WO2018121684A1 (en) * 2016-12-29 2018-07-05 中兴通讯股份有限公司 Head-mounted apparatus, interactive game platform, board game implementation system and method
CN110301013A (en) * 2017-01-17 2019-10-01 皇家飞利浦有限公司 Augmented reality for the predictive workflow in operating room
US11663751B2 (en) 2017-01-18 2023-05-30 Interdigital Vc Holdings, Inc. System and method for selecting scenes for browsing histories in augmented reality interfaces
CN110199525A (en) * 2017-01-18 2019-09-03 Pcms控股公司 For selecting scene with the system and method for the browsing history in augmented reality interface
CN110199525B (en) * 2017-01-18 2021-12-14 Pcms控股公司 System and method for browsing history records in augmented reality interface
CN108572722A (en) * 2017-03-07 2018-09-25 松下航空电子公司 System and method for supporting augmented reality application on transport vehicle
CN108572722B (en) * 2017-03-07 2023-07-21 松下航空电子公司 System and method for supporting augmented reality applications on a transport vehicle
CN106899599A (en) * 2017-03-09 2017-06-27 华东师范大学 A kind of industrial environment outdoor scene enhanced exchange method
CN107168537A (en) * 2017-05-19 2017-09-15 山东万腾电子科技有限公司 A kind of wearable task instruction method and system of collaborative augmented reality
CN107168537B (en) * 2017-05-19 2020-07-07 山东万腾电子科技有限公司 Cooperative augmented reality wearable operation guidance method and system
CN107291999A (en) * 2017-06-01 2017-10-24 中国农业大学 A kind of farming analogy method and system based on virtual reality technology
CN107817799A (en) * 2017-11-03 2018-03-20 北京光年无限科技有限公司 The method and system of intelligent interaction are carried out with reference to virtual maze
CN108055390A (en) * 2017-11-22 2018-05-18 吴东辉 Determine that its client corresponds to the AR method and systems of id based on mobile phone screen color
CN108055390B (en) * 2017-11-22 2021-11-02 厦门瞳景智能科技有限公司 AR method and system for determining corresponding id of client based on mobile phone screen color
CN108255291A (en) * 2017-12-05 2018-07-06 腾讯科技(深圳)有限公司 Transmission method, device, storage medium and the electronic device of virtual scene data
CN108108410A (en) * 2017-12-12 2018-06-01 苏州蜗牛数字科技股份有限公司 A kind of online game labyrinth ground drawing generating method
CN108830944A (en) * 2018-07-12 2018-11-16 北京理工大学 Optical perspective formula three-dimensional near-eye display system and display methods
CN110083235A (en) * 2019-04-08 2019-08-02 聚好看科技股份有限公司 Interactive system and data processing method
CN110448892A (en) * 2019-07-18 2019-11-15 江西中业光文化科技有限公司 Game implementation method and system based on augmented reality
CN110448892B (en) * 2019-07-18 2023-08-22 江西中业光文化科技有限公司 Game realization method and system based on augmented reality
CN110908504B (en) * 2019-10-10 2021-03-23 浙江大学 Augmented reality museum collaborative interaction method and system
CN110908504A (en) * 2019-10-10 2020-03-24 浙江大学 Augmented reality museum cooperative interaction method and system based on user-exhibit distance
CN111862348A (en) * 2020-07-30 2020-10-30 腾讯科技(深圳)有限公司 Video display method, video generation method, video display device, video generation device, video display equipment and storage medium
CN111862348B (en) * 2020-07-30 2024-04-30 深圳市腾讯计算机系统有限公司 Video display method, video generation method, device, equipment and storage medium
CN112102677A (en) * 2020-09-17 2020-12-18 中国人民解放军陆军军医大学 Mixed reality high-simulation battle site emergency training platform and training method thereof

Similar Documents

Publication Publication Date Title
CN102495959A (en) Augmented reality (AR) platform system based on position mapping and application method
US10445939B2 (en) Tactile interaction in virtual environments
KR101670147B1 (en) Portable device, virtual reality system and method
CN105373224B (en) A kind of mixed reality games system based on general fit calculation and method
US20120231887A1 (en) Augmented Reality Mission Generators
CN102939139B (en) Calibration of portable devices in shared virtual space
JP2023021114A (en) Control method of virtual object, device, equipment, and computer program
CN105843396A (en) Maintaining multiple views on a shared stable virtual space
CN110833689A (en) Augmented reality device, method, and program
CN103370672A (en) Method and apparatus for tracking orientation of a user
WO2009002879A1 (en) Real world gaming framework
CN109685909A (en) Display methods, device, storage medium and the electronic device of image
Unal et al. Distant augmented reality: Bringing a new dimension to user experience using drones
US11782500B2 (en) System, method and apparatus of simulating physics in a virtual environment
CN111544889B (en) Behavior control method and device of virtual object and storage medium
Kasapakis et al. Pervasive games research: a design aspects-based state of the art report
TW202119228A (en) Interactive method and system based on optical communication device
Paelke et al. Mobile location-based gaming
JP2023507498A (en) Positioning and mapping using 3D line junctions
Pellerin et al. Soundpark: Towards highly collaborative game support in a ubiquitous computing architecture
CN113920227A (en) Animation playing method, device, equipment, readable storage medium and program product
CN117751339A (en) Interactive augmented reality and virtual reality experience
Poussard et al. 3D-LIVE: D3. 4: Final prototype of the 3D-LIVE platform

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C12 Rejection of a patent application after its publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20120613