CN107967054A - The immersion three-dimensional electronic sand table that a kind of virtual reality is coupled with augmented reality - Google Patents
The immersion three-dimensional electronic sand table that a kind of virtual reality is coupled with augmented reality Download PDFInfo
- Publication number
- CN107967054A CN107967054A CN201711136750.1A CN201711136750A CN107967054A CN 107967054 A CN107967054 A CN 107967054A CN 201711136750 A CN201711136750 A CN 201711136750A CN 107967054 A CN107967054 A CN 107967054A
- Authority
- CN
- China
- Prior art keywords
- sand table
- virtual
- enhancing
- electronic sand
- dimensional
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T17/00—Three dimensional [3D] modelling, e.g. data description of 3D objects
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T19/00—Manipulating 3D models or images for computer graphics
- G06T19/006—Mixed reality
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
- G06F2203/01—Indexing scheme relating to G06F3/01
- G06F2203/012—Walk-in-place systems for allowing a user to walk in a virtual environment while constraining him to a given position in the physical environment
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Computer Graphics (AREA)
- Software Systems (AREA)
- Computer Hardware Design (AREA)
- Geometry (AREA)
- Human Computer Interaction (AREA)
- Processing Or Creating Images (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The invention discloses the immersion three-dimensional electronic sand table that a kind of virtual reality is coupled with augmented reality, including：//the interior enhancing orientation recognition set of tags, virtual of enclosing/enhancing menu area, the control of virtual environment software and driving, the control of enhancing environment software and driving, virtual/, which strengthens electronic sand table and couples three-dimensional visualization, expresses region, virtual implementing helmet and the augmented reality helmet for interior alignment sensor group, the periphery of enclosing for periphery.Virtual electronic sand table is effectively aligned by the present invention based on real physical space with enhancing electronic sand table space；There is provided and virtually couple Visualization with interacting with enhancing electronic sand table；Different shape and size immersion electronic sand table structure needs can be adaptive to；Can/enhancing electronic sand table virtual towards one man operation or multi-user collaborative operation；It can be used in situation expression, spatial visualization, actual situation coupling etc., sand table platform that is more vivid, directly perceived, immersing provided for a variety of application scenarios.
Description
Technical field
The present invention relates to electronic sand table technical field, more particularly to a kind of virtual electronic sand table and enhancing electronic sand table it is mutual
The immersion three-dimensional electronic sand table of coupling.
Background technology
Different from traditional physics sand table, electronic sand table is by the entity in space, phenomenon, event etc., with electronic map
Or the digitlization sand table of computer generation that the mode of virtualization is presented, expressed, simulate etc., it is with flexible and changeable, dynamically
The advantages such as controllable, economical and efficient, have obtained the favor of numerous areas, and have become operational commanding, emergency reaction, disaster are rescued
Help, the critical support means of urban planning etc..By the development of decades, electronic sand table reaches its maturity, and in national defence, warp
The every field such as Ji, city, traffic, business are widely used.As the development of computer technology, electronic sand table are continuous
Develop, develop in dimension from two dimension to three-dimensional even more higher-dimension, in visualization means from computer screen to tripleplane,
CAVE, virtual implementing helmet, augmented reality helmet development.
Two-dimensional electron sand table is that the one kind occurred the 1980s is based on GIS-Geographic Information System and visual by computer
Change the digital map realized.It is based on the symbolism systems such as point, line, surface, according to a certain percentage ruler, by geographic element, force
The three-dimensional information of the real worlds such as device equipment, deployment of forces, evolution trend is compressed in two dimensional surface, and utilizes the superposition of figure layer
Give expression to two-dimensional effects.Compared with conventional physical sand table, Two-dimensional electron sand table can be changed, operated with multiple dimensioned, data are merged
The features such as simplicity, registration, while very well dynamic and visual can be supported to express.But due to the dimension-reduction treatment of information, have
When can make it that the topological relation between entity on three dimensions is misjudged, and then influence effective understanding of information.Visual
In the technique of expression of change, Two-dimensional electron sand table is mainly shown using modes such as computer screen, curtain projections.Such a visualization table
It is convenient, efficient, clear up to mode, it can be difficult to bringing feeling of immersion to user of service.
Three-dimensional electronic sand table is gradually grown up under the promotion of virtual reality technology, it is using at computer graphical
Reason and Display Technique, spacial flex entity, event, relation, evolution etc. in a manner of the three-dimensional even more Visualization of higher-dimension.Phase
Than there is obvious advantage in Two-dimensional electron sand table, three-dimensional electronic sand table.First, three-dimensional electronic sand table is due to using three dimensional constitution
Structure, ensure that integrality of the information in solid space expression, and then greatly improve the comprehensibility of information.Second,
In Visualization mode, the application of stereo projection display technology, CAVE systems etc., greatly improves immersing for user of service
Sense.3rd, three-dimensional electronic sand table can be competent at various visual angles and observe, and be conducive to the space omnidirectional displaying to sand table and understand.
Virtual reality visualizes the new breakthrough with interacting art with augmented reality helmet-type, for structure three-dimensional electronic sand table and carries
Rise its immersive effects and provide good opportunity.Currently, the helmet equipment of a variety of Virtual reality or augmented reality is come out one after another,
Such as HTC Vive, Oculus, 3Glasses, Hololens, storm wind witch mirror, bright wind platform etc..But helmet-type is virtually electric at present
It is also unknown that sub- sand table and enhancing electronic sand table constructing technology are still in conceptual phase, some key technologies, method, application mode etc.
Really, it is necessary to carry out innovative exploration and practice.It is current to have occurred respectively for virtual electronic sand table or the structure of enhancing electronic sand table
Technology is built, also has exploration, still, the prior art with strengthening the linkage that interacts between electronic sand table to realizing virtual electronic sand table
Research and discovery there are it is following obvious the problem of：The linkage of existing virtual electronic sand table and enhancing electronic sand table employs data biography
The pattern passed is realized, that is, three-dimensional electronic sand table is built first in respective space, then realizes two by parameter transmission
Data under space are synchronous, and therefore, the two can not realize coupling in unified physical space, idle loop when can not support unified
The cooperation interaction of virtual/enhancing sand table under border.Solve the problems, such as this, it is necessary to build a kind of based under unified real physical space
The immersion virtual electronic sand table that is coupled with augmented reality of virtual reality.
The content of the invention
In order to overcome the above-mentioned deficiencies of the prior art, the present invention provides a kind of immersion three-dimensional electronic sand table, is a kind of empty
Intend electronic sand table and the platform for strengthening electronic sand table coupling with interacting, enable to virtual electronic sand table and enhancing electronic sand table two
Person carries out visualization in unified real physical space and is interacted with efficient coupling.
Technical solution provided by the invention is：
The immersion three-dimensional electronic sand table that a kind of virtual reality is coupled with augmented reality, including：Peripheral alignment sensor group,
Inside enclose alignment sensor group, periphery strengthens orientation recognition set of tags, interior enclose strengthens orientation recognition set of tags, virtual/enhancing menu
Region, the control of virtual environment software and drive module, the control of enhancing environment software and drive module, virtual/enhancing electronic sand table
Couple the parts such as three-dimensional visualization expression region, virtual implementing helmet, the augmented reality helmet；Peripheral alignment sensor group and
Inside enclosing alignment sensor group includes multiple alignment sensors；Alignment sensor can wirelessly with virtual environment software control
System is communicated with drive module, while provides its own position coordinates and equipment mark code；Periphery enhancing orientation recognition mark
Label group and interior enhancing orientation recognition set of tags of enclosing include multiple enhancing orientation recognition labels；Strengthen orientation recognition label and include increasing
The central point and azimuth information of strong reality label；Virtual environment software is controlled to be mainly used for obtaining sensor letter with drive module
Cease, quickly calculated, rendered and generated virtual environment, realize human-computer interactive control etc., it is main to complete to include inner peripheral positioning
Sensor information is read, reality is drawn with the conversion of virtual location coordinate, virtual console, virtual menu is drawn, virtual electronic is husky
Disk Visualization is sent with interactive controlling, itself interactive information, to functions such as other operator's interactive information receptions；Strengthen ring
Border software control is mainly used for strengthening orientation label acquisition of information and calculating, generation enhancing electronic sand table, realizes with drive module
Human-computer interactive control etc., it is main complete to include inner peripheral enhancing orientation label information is read, reality is changed with enhancing position coordinates,
Strengthen menu drafting, the control of enhancing environmental interaction, enhancing sand table is drawn and Visualization, enhancing environment itself interactive information are sent out
Send and to functions such as other operator's interactive information receptions；Virtually/enhancing electronic sand table coupling three-dimensional visualization expression region
It is the display area of immersion three-dimensional electronic sand table, the edge in the region strengthens orientation knowledge by the interior alignment sensor group and interior enclose of enclosing
Distinguishing label group determines respectively, and the Visualization in region has a coupling of height, represented virtual three dimensional space when
Empty scale is consistent；Virtual implementing helmet realizes the visualization to virtual electronic sand table by virtual reality technology, wears empty
The virtual electronic sand table operating personnel for intending the real helmet are realized to void under the action of the control of virtual environment software with drive module
Intend the operation and use of electronic sand table；The augmented reality helmet is visualized for enhancing electronic sand table, wears augmented reality head
The enhancing electronic sand table operating personnel of helmet realize husky to enhancing electronics under the action of the control of enhancing environment software with drive module
The operation and use of disk.
In the specific implementation, immersion three-dimensional electronic sand table can be the platform of various shapes to the present invention；Inside/outside encloses enhancing
It is corresponding that orientation recognition set of tags with inside/outside encloses alignment sensor group.Peripheral alignment sensor group includes multiple alignment sensors,
It is respectively placed at the angular vertex of platform outer edge, is mainly used for providing outer edge control for virtual electronic sand table platform 3 D rendering
Dot position information processed, so as to limit the peripheral boundary of virtual electronic sand table platform.Inside enclosing alignment sensor group includes multiple positioning
Sensor, is arranged at the angular vertex of platform outer edge certain distance, is mainly used for as the more of virtual electronic sand table
Tie up Visualization and drafting edge control information is provided, and then determine the three-dimensional visualization expression region of virtual electronic sand table.It is fixed
Level sensor can wirelessly be controlled with virtual reality electronic sand table and communicated with drive module, while provide its own
Position coordinates and equipment mark code.
Periphery enhancing orientation recognition set of tags includes multiple enhancing orientation recognition labels, is respectively placed at platform outer edge
At angular vertex, its central point is overlapped with the central point of the alignment sensor at this, for being painted for enhancing electronic sand table platform three-dimensional
System provides outer edge control dot position information, so as to limit the peripheral boundary of enhancing electronic sand table platform.Enhancing orientation is inside enclosed to know
Distinguishing label group includes multiple enhancing orientation recognition labels, is arranged in apart from multiple vertex of platform outer edge certain distance
Place, its central point are overlapped with the central point of the alignment sensor at this, are mainly used for strengthen the multidimensional visualization of electronic sand table
Expression, which provides, draws edge control information, and then determines the three-dimensional visualization expression region of enhancing electronic sand table.Strengthen orientation to know
Distinguishing label is built using Quick Response Code, and Quick Response Code includes the central point and azimuth information of label, which can pass through augmented reality
The tag recognition function of the helmet carries out automatic identification.
Virtually/enhancing menu area is expressed positioned at virtual/enhancing sand table periphery and the three-dimensional visualization of virtual/enhancing sand table
Regional edge is between.The start-stop position of virtually/enhancing menu area is according to the width between two edges, and outer edge vertex
Positional information carries out calculating acquisition.The content and the form of expression of virtually/enhancing menu can be determined according to being actually needed.
Virtual environment software is controlled to be mainly used for obtaining sensor information, is quickly calculated, rendered simultaneously with drive module
Generation virtual environment, realize human-computer interactive control etc., mainly includes the reading of inner peripheral alignment sensor information, reality and virtual bit
Put coordinate conversion, virtual console is drawn, virtual menu is drawn, virtual electronic sand table Visualization and interactive controlling, itself
The functions such as interactive information is sent, other operator's interactive information receive.Wherein inner peripheral alignment sensor information reads main complete
Into the reception of the original location information of inner peripheral sensor；Reality is with the conversion of virtual location coordinate then by the original positioning of sensor
Information is converted into the co-ordinate position information under unified virtual environment；Virtual console is drawn then with sensor position information and mark
It is according to structure virtual electronic sand table platform to know code；Virtual menu draw then in position structure be suitable for situation interaction with
The pseudo operation menu of control；Virtual electronic sand table Visualization is then enclosed in the range of localization region inside, is completed to situation
Three dimensional dynamic FEM expression and simulation etc.；Interactive controlling mainly completes the function of interaction control between operator and situation, real
Driving of the operational order of existing operator to situation, and the driving of the dynamical feedback such as situation information Visualization；Itself interaction
Information sends the collection and packing then completed to the information of the position of itself, operation, action etc., is then sent to it by network
He is operating personnel；Other operator's interactive information, which receive then to be responsible for receiving, comes from other operators' under consolidated network environment
The information that operating interactive produces, and Visualization function module is transferred to, complete the virtualization expression to operating personnel.
The control of enhancing environment software is mainly used for enhancing orientation label acquisition of information and calculates with drive module, generation strengthens
Electronic sand table, realize human-computer interactive control etc., mainly includes the reading of inner peripheral enhancing orientation label information, reality and enhancing position
Coordinate conversion, enhancing menu are drawn, enhancing environmental interaction controls, enhancing sand table is drawn and Visualization, enhancing environment itself
The functions such as interactive information is sent and other operator's interactive information receive.Wherein strengthen orientation label acquisition of information with having been calculated
The scanning recognition of enhancing orientation label in pairs, obtains position therein and azimuth information；Reality is changed then with enhancing position coordinates
The co-ordinate position information position of acquisition and azimuth information being converted under unified enhancing environment；Strengthen menu to draw then suitable
When position structure be suitable for situation interaction with control enhancing actions menu；Including strengthening sand table drafting and Visualization then
Enclose in the regional extent that label determines, using the technique of expression of augmented reality complete to the expression of the three dimensional dynamic FEM of situation with
Simulation etc.；Interactive controlling module mainly completes the function of interaction control between operator and situation, realizes that the operation of operator refers to
Make the driving to situation, and the driving of the dynamical feedback such as situation information Visualization.Itself interactive information sends then completion pair
The collection and packing of the information of itself position, operation, action etc., are then sent to other operating personnel by network；Other
Operator's interactive information, which receives, is then responsible for what the operating interactive for receiving other operators come under consolidated network environment produced
Information, and Visualization function module is transferred to, complete the virtualization expression to operating personnel.
Virtually/enhancing electronic sand table coupling three-dimensional visualization expression region is that the electronics under virtual/enhancing both of which is husky
The common display area of disk.Alignment sensor group is enclosed by interior and interior to enclose enhancing orientation recognition set of tags difference true in the edge in the region
It is fixed.Under actual environment, which can also aid in certain station location marker or physical without any equipment or material object
Face.Based on the unified real physical space, the complete coupling of virtual electronic sand table and the realization of enhancing electronic sand table spatially.
Virtual implementing helmet mainly uses virtual reality technology, realizes the visualization to virtual electronic sand table.Virtual reality
The space orientation of the helmet is mutually matched with alignment sensor, so as to fulfill the virtual sand table platform in virtual implementing helmet and reality
Position sensor in environment is consistent.The augmented reality helmet have the function of with virtual implementing helmet it is similar, but its
It is to be visualized for enhancing electronic sand table.
Virtual electronic sand table operator is that personnel are implemented in the operation of virtual electronic sand table, it wears virtual implementing helmet,
And under the action of the control of virtual environment software with drive module, realize the operation and use to virtual electronic sand table.Similarly,
Enhancing electronic sand table operator is that personnel are implemented in the operation for strengthening electronic sand table, it wears the augmented reality helmet, and is strengthening
Environment software is controlled with the action of drive module, realizing operation and use to strengthening electronic sand table.
When above-mentioned virtual electronic sand table is with enhancing electronic sand table coupling with the working platform interacted, it can provide at following
Multiple-working mode：
(1) a virtual electronic sand table operator is supported to operate with, i.e. the only person of operating with, it is empty by wearing
Intend the real helmet, carry out the operation and use of virtual electronic sand table；
(2) support multiple virtual electronic sand table operators to operate with, that is, there are multiple persons of operating with to simultaneously participate in platform
Using, each participant respectively wears a virtual implementing helmet, everybody carries out cooperating in face of same virtual electronic sand table,
The operational motion of operators all at the same time can be perceived with result by other people and Visualization；
(3) support an enhancing electronic sand table operator to operate with, i.e. the only person of operating with, increased by wearing
The strong reality helmet, carries out the operation and use of enhancing electronic sand table；
(4) support multiple enhancing electronic sand table operators to operate with, that is, there are multiple persons of operating with to simultaneously participate in platform
Using, each participant respectively wears an augmented reality helmet, everybody carries out cooperating in face of same enhancing electronic sand table,
The operating result of operators all at the same time can be perceived by other people and Visualization；
(5) a virtual electronic sand table operator and multiple enhancing electronic sand table operators is supported to operate with the same time, i.e.,
There are multiple persons of operating with to simultaneously participate in platform use, wherein there is a participant to wear virtual implementing helmet, other people (are more than
One people) wear the augmented reality helmet.The operator of virtual implementing helmet is worn it is seen that virtual electronic sand table, and is increased with wearing
The operator of the strong reality helmet is it is seen that enhancing electronic sand table.The viewable area of virtual reality sand table and augmented reality sand table
It is coupling in virtual/enhancing electronic sand table Visualization region.The border of both of which electronic sand table is consistent, zoom
Synchronous, operation is synchronously.Operating result under both of which mutual perception and can carry out Visualization.
(6) multiple virtual electronic sand table operators and an enhancing electronic sand table operator is supported to operate with the same time, i.e.,
There are multiple persons of operating with to simultaneously participate in platform use, wherein there is a participant to wear the augmented reality helmet, other people (are more than
One people) wear virtual implementing helmet.The operator of virtual implementing helmet is worn it is seen that virtual electronic sand table, it is existing to wear enhancing
The operator of the real helmet is it is seen that enhancing electronic sand table.The viewable area of virtual reality sand table and augmented reality sand table is by coupling
Close in virtual/enhancing electronic sand table Visualization region.The border of both of which electronic sand table is consistent, zoom is same
Step, operation are synchronous.Operating result under both of which mutual perception and can carry out Visualization.
(7) multiple virtual electronic sand table operators and multiple enhancing electronic sand table operators is supported to operate with the same time, i.e.,
There are multiple persons of operating with to simultaneously participate in platform use, wherein there are multiple participants (being more than a people) to wear the augmented reality helmet,
Other people wear virtual implementing helmet at (being more than a people).The operator of virtual implementing helmet is worn it is seen that virtual electronic is husky
Disk, and the operator of the augmented reality helmet is worn it is seen that enhancing electronic sand table.Virtual reality sand table and augmented reality sand table
Viewable area be coupling in virtual/enhancing electronic sand table Visualization region.The border of both of which electronic sand table
Unanimously, zoom is synchronous, operation is synchronous.Operating result under both of which mutual perception and can carry out Visualization.
Compared with prior art, the beneficial effects of the invention are as follows：
The present invention provides a kind of virtual electronic sand table and the coupling of enhancing electronic sand table and the immersion three-dimensional electronic interacted are husky
Disk platform, enabling to virtual electronic sand table and enhancing both electronic sand tables to be carried out under unified real physical space can
Interacted depending on changing with effective integration.The present invention has at least following new features and technical advantage：
First, based on real physical space, using alignment sensor and strengthen orientation recognition label by virtual electronic sand table
Effectively it is aligned with two kinds of spaces of enhancing electronic sand table, has accomplished that there is therebetween Space Consistency；
Second, under the action of Space Consistency, form virtual electronic sand table and couple visualization table with enhancing electronic sand table
Reach and interaction capabilities；
3rd, using alignment sensor and enhancing orientation recognition label as the control mode on border, can be adaptive to not
Similar shape, different scale electronic sand table structures need；
4th, which can be utilized respectively virtual or enhancing both of which towards more people, which carries out sand table cooperation interaction, makes
With a certain pattern that can also be towards single use virtually or in enhancing interact use.
This electronic sand table can be used in situation expression, spatial visualization, actual situation coupling etc., can be operational commanding,
The more visual in image visualization of the offers such as urban planning, emergency reaction, disaster assistance and interactive mode, lift user of service couple
The abilities such as the cognition of research object, control.
Brief description of the drawings
Fig. 1 is virtually with strengthening the electronic sand table interaction platform overall construction drawing coupled；
Fig. 2 is alignment sensor and enhancing orientation recognition label relation schematic diagram；
Fig. 3 is virtual electronic sand table and the coupling of enhancing electronic sand table and interaction platform control information link schematic diagram；
In Fig. 1~Fig. 3：
11-the first group periphery alignment sensor and enhancing orientation recognition label；
12-the second group periphery alignment sensor and enhancing orientation recognition label；
13-the three group of periphery alignment sensor and enhancing orientation recognition label；
14-the four group of periphery alignment sensor and enhancing orientation recognition label；
Alignment sensor and enhancing orientation recognition label are enclosed in 15-the first group；
Alignment sensor and enhancing orientation recognition label are enclosed in 16-the second group；
Alignment sensor and enhancing orientation recognition label are enclosed in 17-the three group；
Alignment sensor and enhancing orientation recognition label are enclosed in 18-the four group；
11-1-protection and installation fitting；
11-2-enhancing orientation recognition label；
11-3-alignment sensor；
21st, 22,23,24-virtual/enhancing menu area；
30-virtual environment software controls and drive module；
31-inner peripheral alignment sensor information is read；
32-reality/virtual location coordinate conversion；
33-virtual console is drawn；
34-virtual menu is drawn；
35-virtual electronic sand table Visualization；
36-virtual environment interactive controlling；
37-virtual environment itself interactive information is sent；
The control of 40-enhancing environment software and drive module；
41-inner peripheral enhancing orientation label information is read；
42-reality/enhancing position coordinates conversion；
43-enhancing menu is drawn；
44-enhancing sand table is drawn and Visualization；
45-enhancing environmental interaction control；
46-enhancing environment itself interactive information is sent；
47-other operator's interactive information receive；
50-virtual implementing helmet；
60-augmented reality helmet；
70-virtual/enhancing electronic sand table coupling three-dimensional visualization expression region.
Embodiment
Below in conjunction with the accompanying drawings, the present invention is further described by implementing example, but do not limit the invention in any way
Scope.Further, expressed electronic sand table rectangular shape is only intended to illustrate below, can not limit the present invention to flat
The claim of platform various shapes.
The present invention provides a kind of virtual electronic sand table and the coupling of enhancing electronic sand table and the immersion three-dimensional electronic interacted are husky
Disk platform, enables to virtual electronic sand table can be in unified control platform and indication range with enhancing both electronic sand tables
Visualization is carried out in (interactive space) to interact with effective integration.
Fig. 1 is provided by the invention a kind of virtually with strengthening the immersion three-dimensional electronic sand table interaction platform coupled totally knot
Structure schematic diagram.In the present embodiment, this platform includes：Peripheral alignment sensor group and periphery enhancing orientation recognition set of tags 11
~14, it is interior enclose alignment sensor group and it is interior enclose enhancing orientation recognition set of tags 15~18, virtual/enhancing menu area 21~24,
Virtual environment software controls and drive module 30, the control of enhancing environment software and drive module 40, virtual implementing helmet 50, enhancing
The real helmet 60, virtual/enhancing electronic sand table coupling three-dimensional visualization expression region 70, virtual electronic sand table operator, enhancing
The parts such as electronic sand table operator.
Inside/outside, which encloses alignment sensor group and inside/outside and encloses enhancing orientation recognition set of tags, to be coupled, and each group includes one
A alignment sensor and an enhancing orientation recognition label.For the ease of installing and playing the protection effect to sensor and label
Fruit, equipped with protection and installation fitting below each group.Fig. 2 is alignment sensor and enhancing orientation recognition label relation schematic diagram.
Alignment sensor, enhancing orientation recognition label and the structural relation of protection and installation fitting can be any one of Fig. 2
Situation.Alignment sensor can be placed in above or below enhancing orientation recognition label.But no matter use any mode,
The front pattern of enhancing orientation recognition label must not be blocked all.Wherein alignment sensor can be Bluetooth transmission source,
The active sensors such as WIFI emission sources or pass through optical identification point-like ball etc. passively calculate positioning inductor.Strengthen orientation
Identification label can be Quick Response Code, or any figure that predefined is good.
In Fig. 1, by peripheral alignment sensor group and the peripheral region for strengthening orientation recognition set of tags and surrounding, and by periphery
The region that alignment sensor group and periphery enhancing orientation recognition set of tags surround, its construction method can have a variety of such as following
Three kinds of schemes：1. being surrounded to form actual physics tables with timber, steel etc. completely, material objectization table top is formed；2. by portion
Divide desktop to be surrounded using timber, steel etc., form part material objectization table top；3. only placed on 8 vertex sensor groups and
Strengthen orientation recognition set of tags, do not place any material object elsewhere, form virtualization table top.
Fig. 3 is virtual electronic sand table and the coupling of enhancing electronic sand table and interaction platform control information connecting link schematic diagram.
As shown in figure 3, the control of virtual environment software includes inner peripheral alignment sensor information reading 31, reality/empty with drive module 30
Intend position coordinates conversion 32, virtual console draws 33, virtual menu and draws 34, virtual electronic sand table Visualization 35, void
Near-ring border interactive controlling 36, virtual environment itself interactive information send 37, other operator's interactive information and receive of the functions such as 38
Module.These submodule functions can be realized by computer, microcontroller etc..Wherein inner peripheral alignment sensor information reads 31
Under the support of information receiving device, by programs such as the reception of data, identifications, the interpretation to position is completed.Reality/virtual bit
Putting coordinate and changing 32 functions is realized by the software on backstage, is mainly realized by coordinate rotation and translation scheduling algorithm.Virtual control
Platform processed is drawn 33 and is built using three dimentional graph display, such as OpenGL, DirectX, Unity3D, Unreal Engine etc..Together
When, the position that the position of the virtual console is determined with inner peripheral alignment sensor is consistent.Virtual menu is drawn 34 and is utilized
UI interface tech is built, and the style at interface can be any one of two dimension or three-dimensional.Virtual electronic sand table Visualization
35 are built using the d engines identical with virtual console drafting 33.The Visualization can be plane or three
Dimension is dynamic.Virtual environment interactive controlling 36 can be real by various ways such as virtual mouse, the seizure of interactive action, UI triggerings
It is existing.It is background communication program that virtual environment itself interactive information, which sends 37, can be realized by Socket；The link of transmission can be with
It is cable network or wireless network.It is also background communication program that other operator's interactive information, which receive 38, can equally be used
Socket is realized；The link of reception can also be cable network or wireless network.
Strengthen environment software control and read 41, reality/increasing including inner peripheral enhancing orientation label information with drive module 40
Strong position coordinate conversion 42, enhancing menu are drawn 43, enhancing sand table and are drawn and Visualization 44, enhancing environmental interaction control
45th, strengthen environment itself interactive information to send 46 and receive the function sub-modules such as 47 to other operator's interactive information.These
Submodule function can be realized by computer or the augmented reality helmet etc..Wherein inner peripheral enhancing orientation label information is read
31 are using incidental tag scan equipment and identification software on the augmented reality helmet, complete the scanning to label and mark
Sign the extraction of the information such as position, orientation, identification code.Reality/enhancing position coordinates conversion 42, mainly passes through coordinate rotation and translation
Scheduling algorithm realize, can also utilize the augmented reality helmet it is incidental immediately positioning with map structuring function (SLAM,
Simultaneous localization and mapping) realize.Strengthen menu drafting 43 to build using UI interface tech,
The style at interface can be any one of two dimension or three-dimensional.Strengthen sand table drafting to utilize towards enhancing with Visualization 44
The three dimentional graph display structure of reality, such as Unity3D.Strengthen environmental interaction control 45 can by visual observation, voice, gesture,
The various ways such as UI triggerings are realized.It is background communication program to strengthen environment itself interactive information to send 46, can be existing by strengthening
The communication program of the real helmet realizes that the link of transmission can use wireless network.And other operator's interactive information receive 47
And background communication program, equally the communication program of the augmented reality helmet can be used to realize that the link of reception can also be nothing
Gauze network.
In order to which technical problem, technical solution and beneficial effect solved by the invention is more clearly understood, below to this
The use of invention illustrates.Virtual implementing helmet is worn respectively with more people below and augmented reality helmet both of which is assisted
Exemplified by biconditional operation, the use of platform is explained.It should be appreciated that it is described herein specifically used only to explain the present invention, and
It is not used in the restriction present invention.
The first step：The module of integrated positioning sensor group and enhancing orientation recognition set of tags is installed on to 8 angles of desk
Point, or be rest directly upon a piece of idle area and form two square boundaries as shown in Figure 1.
Second step：Some of the staff wear virtual implementing helmet, and the adjustment helmet makes it more comfortable.Helmet link is provided with
Virtual environment software controls the computer with drive module.
3rd step：Some of the staff wear the augmented reality helmet, and the adjustment helmet makes it more comfortable.
4th step：Open and the control of virtual environment software and the computer of drive module are installed, and it is soft to start virtual environment
Part controls and drive module program, reading alignment sensor positional information, drafting virtual electronic sand table platform, in virtual menu area
Virtual menu is drawn in domain, and virtual electronic sand table is drawn in Visualization region.
5th step：The augmented reality helmet is opened, scanning enhancing orientation label, draws enhancing electronic sand table platform, virtual
Menu area draws enhancing menu, and enhancing electronic sand table is drawn in Visualization region.
6th step：Virtual electronic sand table operator is by virtual menu, virtual mouse, action gesture, voice etc., to virtual
Electronic sand table is amplified, reduces, rotates, marks, edits, at the same can see other operating personnel avatar and its
The Visualization effect of operating result.Meanwhile strengthen electronic sand table operator by strengthening menu, visually action gesture, note
Depending on, voice etc., enhancing electronic sand table is amplified, reduce, rotate, mark, edit, while can see other staff and grasp
Make the Visualization effect of result.
7th step：After end of operation, virtual electronic sand table operator exits virtual environment, removes the helmet, shuts down computer.
Meanwhile strengthen electronic sand table operator and exit enhancing environment, close the augmented reality helmet.
It should be noted that the purpose for publicizing and implementing example is that help further understands the present invention, but the skill of this area
Art personnel are appreciated that：Do not departing from the present invention and spirit and scope of the appended claims, various substitutions and modifications are all
It is possible.Therefore, the present invention should not be limited to embodiment disclosure of that, and the scope of protection of present invention is with claim
Subject to the scope that book defines.
Claims (6)
1. the immersion three-dimensional electronic sand table that a kind of virtual reality is coupled with augmented reality, including：It is peripheral alignment sensor group, interior
Enclose alignment sensor group, periphery strengthens orientation recognition set of tags, interior enclose strengthens orientation recognition set of tags, virtual/enhancing menu area
Domain, the control of virtual environment software and drive module, the control of enhancing environment software and drive module, virtual/enhancing electronic sand table coupling
Close three-dimensional visualization expression region, virtual implementing helmet and the augmented reality helmet；Wherein：
Peripheral alignment sensor group and interior alignment sensor group of enclosing include multiple alignment sensors；Alignment sensor can pass through nothing
Line mode and the control of virtual environment software are communicated with drive module, while provide its own position coordinates and device identification
Code；Periphery enhancing orientation recognition set of tags and interior enhancing orientation recognition set of tags of enclosing include multiple enhancing orientation recognition labels；
Enhancing orientation recognition label includes the central point and azimuth information of augmented reality label；
Virtual environment software is controlled to be used to obtain sensor information, is quickly calculated, rendered and generated virtually with drive module
Environment, realize human-computer interactive control, and completion includes the reading of inner peripheral alignment sensor information, reality and actual situation position coordinates and turns
Change, virtual console is drawn, virtual menu is drawn, virtual electronic sand table Visualization and interactive controlling, itself interactive information
Send, to other operator's interactive information receive capabilities；
The control of enhancing environment software is with drive module for strengthening orientation label acquisition of information and calculating, generation enhancing electronics sand
Disk, realize human-computer interactive control etc., and completion includes the reading of inner peripheral enhancing orientation label information, reality turns with enhancing position coordinates
Change, strengthen menu draw, enhancing environmental interaction control, enhancing sand table draw with Visualization, strengthen environment itself interact letter
Breath is sent and the receive capabilities to other operator's interactive information；
Virtually/enhancing electronic sand table coupling three-dimensional visualization expression region is the display area of immersion three-dimensional electronic sand table, should
The edge in region by it is interior enclose alignment sensor group and it is interior enclose enhancing orientation recognition set of tags determine respectively；Visualization table in region
Up to the coupling with height, the spatial and temporal scales of represented virtual three dimensional space are consistent；
Virtual implementing helmet realizes the visualization to virtual electronic sand table by virtual reality technology, wears virtual implementing helmet
Virtual electronic sand table operating personnel are realized to virtual electronic sand table under the action of the control of virtual environment software with drive module
Operation and use；The augmented reality helmet is visualized for enhancing electronic sand table；Wear the enhancing electronics of the augmented reality helmet
Sand table operating personnel are realized to the operation for strengthening electronic sand table with making under the action of the control of enhancing environment software with drive module
With.
2. immersion three-dimensional electronic sand table as claimed in claim 1, it is characterized in that, the immersion three-dimensional electronic sand table is one
Meaning shape platform；Periphery enhancing orientation recognition set of tags is corresponding with inner peripheral alignment sensor group；The periphery orientation sensing
Device group includes multiple alignment sensors, is individually positioned at the angular vertex of platform outermost, for determining that virtual electronic sand table is put down
The outer edge of platform, realizes overlapping for virtual electronic sand table and physics table top；Alignment sensor group is enclosed in described also including multiple fixed
Level sensor, be individually positioned in enclose at angular vertex, for determining the edge of virtual electronic sand table viewable area.
3. immersion three-dimensional electronic sand table as claimed in claim 2, it is characterized in that, peripheral alignment sensor group, interior enclose position biography
Sensor group, periphery enhancing orientation recognition set of tags, interior enhancing orientation recognition set of tags of enclosing are embedded in electronic sand table material object desktop
On, or do not use desktop support and placed using modes such as stents.
4. immersion three-dimensional electronic sand table as claimed in claim 2, it is characterized in that, virtual/enhancing menu area is arranged on positioning
The interior surrounding edge that sensor group or enhancing orientation recognition set of tags are formed along and periphery sides between, for for virtual electronic sand table and
The operation for strengthening electronic sand table provides human-computer interaction interface.
5. immersion three-dimensional electronic sand table as claimed in claim 1, it is characterized in that, virtual/enhancing electronic sand table coupling three-dimensional can
Depending on change expression region by it is interior enclose alignment sensor group/or it is interior enclose enhancing orientation recognition set of tags determine, for virtual electronic sand table
With the three-dimensional visualization expression of enhancing electronic sand table.
6. immersion three-dimensional electronic sand table as claimed in claim 1, it is characterized in that, the immersion three-dimensional electronic sand table is used for more
Kind operating mode, including：More people are utilized respectively virtual or enhancing both of which development sand table cooperation interaction and use, is single using empty
Intend or enhancement mode interacts use.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711136750.1A CN107967054B (en) | 2017-11-16 | 2017-11-16 | Immersive three-dimensional electronic sand table with virtual reality and augmented reality coupled |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711136750.1A CN107967054B (en) | 2017-11-16 | 2017-11-16 | Immersive three-dimensional electronic sand table with virtual reality and augmented reality coupled |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN107967054A true CN107967054A (en) | 2018-04-27 |
| CN107967054B CN107967054B (en) | 2020-11-27 |
Family
ID=62001132
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201711136750.1A Active CN107967054B (en) | 2017-11-16 | 2017-11-16 | Immersive three-dimensional electronic sand table with virtual reality and augmented reality coupled |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107967054B (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111104470A (en) * | 2019-11-19 | 2020-05-05 | 青岛海信网络科技股份有限公司 | Method and system for linkage of electronic sand table and emergency platform |
| CN111199561A (en) * | 2020-01-14 | 2020-05-26 | 上海曼恒数字技术股份有限公司 | Multi-person cooperative positioning method and system for virtual reality equipment |
| WO2022047768A1 (en) * | 2020-09-07 | 2022-03-10 | 桂林旅游学院 | Virtual experience system and method combining hololens and cave |
| CN114531582A (en) * | 2020-11-02 | 2022-05-24 | 华为技术有限公司 | Augmented reality function control method and electronic equipment |
| CN117351797A (en) * | 2023-10-23 | 2024-01-05 | 江苏安承科技有限公司 | Position real-time linkage system |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102884490A (en) * | 2010-03-05 | 2013-01-16 | 索尼电脑娱乐美国公司 | Maintaining multiple views on a shared stable virtual space |
| CN103460256A (en) * | 2011-03-29 | 2013-12-18 | 高通股份有限公司 | Anchoring virtual images to real world surfaces in augmented reality systems |
| US20150123966A1 (en) * | 2013-10-03 | 2015-05-07 | Compedia - Software And Hardware Development Limited | Interactive augmented virtual reality and perceptual computing platform |
| CN105027190A (en) * | 2013-01-03 | 2015-11-04 | 美达公司 | Extramissive spatial imaging digital eye glass for virtual or augmediated vision |
| CN105425955A (en) * | 2015-11-06 | 2016-03-23 | 中国矿业大学 | Multi-user immersive full-interactive virtual reality engineering training system |
| CN105679169A (en) * | 2015-12-31 | 2016-06-15 | 中国神华能源股份有限公司 | Railway electronic sand table system |
| CN106383578A (en) * | 2016-09-13 | 2017-02-08 | 网易（杭州）网络有限公司 | Virtual reality system, and virtual reality interaction apparatus and method |
-
2017
- 2017-11-16 CN CN201711136750.1A patent/CN107967054B/en active Active
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102884490A (en) * | 2010-03-05 | 2013-01-16 | 索尼电脑娱乐美国公司 | Maintaining multiple views on a shared stable virtual space |
| CN103460256A (en) * | 2011-03-29 | 2013-12-18 | 高通股份有限公司 | Anchoring virtual images to real world surfaces in augmented reality systems |
| CN105027190A (en) * | 2013-01-03 | 2015-11-04 | 美达公司 | Extramissive spatial imaging digital eye glass for virtual or augmediated vision |
| US20150123966A1 (en) * | 2013-10-03 | 2015-05-07 | Compedia - Software And Hardware Development Limited | Interactive augmented virtual reality and perceptual computing platform |
| CN105425955A (en) * | 2015-11-06 | 2016-03-23 | 中国矿业大学 | Multi-user immersive full-interactive virtual reality engineering training system |
| CN105679169A (en) * | 2015-12-31 | 2016-06-15 | 中国神华能源股份有限公司 | Railway electronic sand table system |
| CN106383578A (en) * | 2016-09-13 | 2017-02-08 | 网易（杭州）网络有限公司 | Virtual reality system, and virtual reality interaction apparatus and method |
Non-Patent Citations (1)
| Title |
|---|
| 谭树人等: "增强现实电子沙盘及关键技术研究", 《系统仿真学报》 * |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111104470A (en) * | 2019-11-19 | 2020-05-05 | 青岛海信网络科技股份有限公司 | Method and system for linkage of electronic sand table and emergency platform |
| CN111199561A (en) * | 2020-01-14 | 2020-05-26 | 上海曼恒数字技术股份有限公司 | Multi-person cooperative positioning method and system for virtual reality equipment |
| CN111199561B (en) * | 2020-01-14 | 2021-05-18 | 上海曼恒数字技术股份有限公司 | Multi-person cooperative positioning method and system for virtual reality equipment |
| WO2022047768A1 (en) * | 2020-09-07 | 2022-03-10 | 桂林旅游学院 | Virtual experience system and method combining hololens and cave |
| CN114531582A (en) * | 2020-11-02 | 2022-05-24 | 华为技术有限公司 | Augmented reality function control method and electronic equipment |
| CN114531582B (en) * | 2020-11-02 | 2023-06-13 | 华为技术有限公司 | Augmented reality function control method and electronic equipment |
| CN117351797A (en) * | 2023-10-23 | 2024-01-05 | 江苏安承科技有限公司 | Position real-time linkage system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN107967054B (en) | 2020-11-27 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107967054A (en) | The immersion three-dimensional electronic sand table that a kind of virtual reality is coupled with augmented reality | |
| CN103246351B (en) | A kind of user interactive system and method | |
| CN105659295B (en) | For indicating the method for point of interest in the view of true environment on the mobile apparatus and for the mobile device of the method | |
| CN103793060B (en) | A kind of user interactive system and method | |
| CN108762482B (en) | Data interaction method and system between large screen and augmented reality glasses | |
| CN107369205B (en) | Mobile terminal city two-dimensional and three-dimensional linkage display method | |
| CN103064514A (en) | Method for achieving space menu in immersive virtual reality system | |
| CN106134186A (en) | Distant existing experience | |
| CN104484523A (en) | Equipment and method for realizing augmented reality induced maintenance system | |
| CN103049934A (en) | Roam mode realizing method in three-dimensional scene simulation system | |
| CN103679204A (en) | Image identification and creation application system and method based on intelligent mobile device platform | |
| CN103116857A (en) | Virtual sample house wandering system based on body sense control | |
| CN107122045A (en) | A kind of virtual man-machine teaching system and method based on mixed reality technology | |
| CN105512136A (en) | Method and device for processing based on layer | |
| CN109145802A (en) | More manpower gesture man-machine interaction methods and device based on Kinect | |
| CN110515455A (en) | It is a kind of based on the dummy assembly method cooperateed in Leap Motion and local area network | |
| CN106898049A (en) | A kind of spatial match method and system for mixed reality equipment | |
| CN104751515A (en) | Real estate building exhibition method | |
| CN203721060U (en) | Virtual reality simulator for crane operation | |
| CN103699219A (en) | Intelligent glasses interaction system and intelligent interaction method | |
| CN107945285A (en) | A kind of threedimensional model is exchanged cards containing all personal details and become sworn brothers figure and deformation method | |
| CN109033535A (en) | A kind of Design of Production Line visualization system based on VR technology | |
| CN104866121A (en) | Drawing system and drawing method for three-dimensional model | |
| CN106569044A (en) | Immersive virtual reality system-based electromagnetic spectrum situation observation method | |
| CN111047708A (en) | Complex equipment high-risk project training system based on mixed reality |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |