CN109685887A - A kind of accurate occlusion method of AR actual situation based on HoloLens - Google Patents
A kind of accurate occlusion method of AR actual situation based on HoloLens Download PDFInfo
- Publication number
- CN109685887A CN109685887A CN201811451850.8A CN201811451850A CN109685887A CN 109685887 A CN109685887 A CN 109685887A CN 201811451850 A CN201811451850 A CN 201811451850A CN 109685887 A CN109685887 A CN 109685887A
- Authority
- CN
- China
- Prior art keywords
- hololens
- message
- script
- unity3d
- model
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T17/00—Three dimensional [3D] modelling, e.g. data description of 3D objects
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T19/00—Manipulating 3D models or images for computer graphics
- G06T19/006—Mixed reality
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T19/00—Manipulating 3D models or images for computer graphics
- G06T19/20—Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
- G06F2203/01—Indexing scheme relating to G06F3/01
- G06F2203/012—Walk-in-place systems for allowing a user to walk in a virtual environment while constraining him to a given position in the physical environment
Abstract
The invention discloses a kind of accurate occlusion method of AR actual situation based on HoloLens, is related to augmented reality field, comprising the following steps: S10, selected real-world object；S20, real-world object is modeled in 3 d modeling software, and adds visible material, the model of generation is saved into the format that can import Unity3D editing machine；S30, model is imported into Unity3D engineering；S40, self-defined message script, collaboration script and configuration script are write；S50, AR program Unity3D engineering is loaded the script into, and Unity3D engineering is published to HoloLens operation；S60, HoloLens engineering information is configured in Unity3D engineering medium-long range；S70, long-range preservation are with the engineering postponed.The present invention eliminates the operation for needing scanning circumstance etc. additional by solving the problems, such as that real world objects have gap in AR mutual occlusion.
Description
Technical field
The present invention relates to the accurate sides of blocking of the augmented reality field (AR) more particularly to a kind of AR actual situation based on HoloLens
Method.
Background technique
HoloLens is the first holographic computer equipment not limited by cable of Microsoft, is that a augmented reality (AR) is set
It is standby, user can be allowed to interact with digital content, and interact with the hologram in true environment around.User wear HoloLens it
Real world can be not only watched by the lens in equipment afterwards, but also can see the virtual image that equipment is shown on lens.
HoloLens have multiple sensors can capture the mobile message of user's head action message and user in real world this
User surrounding environment color and depth information can also be captured outside.HoloLens calculates virtual image using these information in real time
Corresponding position is shown just as being fixed in real world virtual image, and user is made to see the vision of augmented reality
Effect.
Virtual image projects on lens at present, and without technical treatment, virtual image can block forever
Real world.Microsoft provides a kind of Spatial mapping technical solution solution occlusion issue.Spatial mapping skill
Corresponding position of the data for the real world that art to the effect that utilizes sensor to return in Virtual Space creates material, by wound
The occlusion effect of real world and virtual image is presented in the material built.
Microsoft's Spatial mapping technology can not be pin-pointed to object space, size and profile in real world.
Dummy object is caused to occur the office of the partial occlusion of mistake or mistake in the case that object blocks in by real world in this way
Portion is shown.Especially the object of real world is not covered by material after device software creates material there are many gap, is caused
Dummy object is showed to come by the leakage of mistake, affects user experience.In addition, being opened every time using Spatial mapping technology
It requires first to operate using the scanning circumstance that HoloLens carries out a period of time after application program.Scanning circumstance operation is with certain
It is technical, operate it is more troublesome.
Therefore, those skilled in the art is dedicated to developing a kind of accurate occlusion method of AR actual situation based on HoloLens.
Summary of the invention
In view of the above drawbacks of the prior art, the technical problem to be solved by the present invention is to real world objects to exist
There are the operation bidirectionals in gap and scanning circumstance in HoloLens.
To achieve the above object, the present invention provides a kind of accurate occlusion method of AR actual situation based on HoloLens.
In one embodiment of the present of invention, a kind of accurate occlusion method of AR actual situation based on HoloLens provided, including
Following steps:
S10, selected real-world object；
S20, modeling model above-mentioned real-world object in 3 d modeling software, and add visible material, will give birth to
At model save at the format that can import Unity3D editing machine；
S30, model import, and above-mentioned model is imported AR program Unity3D engineering；
S40, script edit write self-defined message script, collaboration script and configuration script；
S50, script load and model publication, are loaded into above-mentioned AR program Unity3D engineering for above-mentioned script, and will be above-mentioned
AR program Unity3D engineering is published to HoloLens operation；
S60, configuration configure the above-mentioned AR program Unity3D engineering being published in HoloLens；
S70, preservation save above-mentioned AR program Unity3D engineering.
Optionally, the accurate occlusion method of AR actual situation based on HoloLens in the above-described embodiments, it is above-mentioned customized to disappear
Breath script includes sending pose message, obtaining pose message, closed position configuration message, open position synchronization message, open and match
Lock message is set, configuration lock message is closed, is set as special transparent material message, cancels transparent material message, addition world's anchor
Point message removes world's anchor point message.
Further, the accurate occlusion method of AR actual situation based on HoloLens in any of the above-described embodiment, in response to
Above-mentioned collaboration script sends object pose message in Unity3D editing machine, and HoloLens simultaneously operating model adjusts pose.
Further, the accurate occlusion method of AR actual situation based on HoloLens in any of the above-described embodiment, in response to
The new position adjusted is sent above-mentioned addition world anchor point message by above-mentioned configuration script, and HoloLens is saved.
Optionally, the accurate occlusion method of AR actual situation based on HoloLens in any of the above-described embodiment, above-mentioned steps
S60 includes:
S61, adjustment model pose, when the model observed in HoloLens object corresponding with real world is not overlapped
When, pose message is sent to HoloLens in response to above-mentioned collaboration script, change function is used in above-mentioned Unity3D editing machine
Adjust the model pose in above-mentioned AR program Unity3D engineering；
S62, anchor point is saved, the above-mentioned addition world anchor point comprising relevant parameter sent in response to above-mentioned configuration script disappears
Breath, world's anchor point of the long-range preservation model of HoloLens；
S63, replacement model material above-mentioned be set as special transparent material and disappear in response to what above-mentioned configuration script was sent
Breath, it is special transparent material that HoloLens, which remotely replaces model material,.
Optionally, the accurate occlusion method of AR actual situation based on HoloLens in any of the above-described embodiment, by above-mentioned
Special transparent material, it can be seen that the real world blocked can not see the dummy object blocked.
Optionally, the accurate occlusion method of AR actual situation based on HoloLens in any of the above-described embodiment, above-mentioned three-dimensional
Modeling software includes professional software and the software with modeling function.
Further, the accurate occlusion method of AR actual situation based on HoloLens in any of the above-described embodiment, above-mentioned band
The software of modeling function is Unity3D.
Further, the accurate occlusion method of AR actual situation based on HoloLens in any of the above-described embodiment, above can be with
The format for importing above-mentioned Unity3D editing machine includes .fbx and .obj.
Optionally, the accurate occlusion method of AR actual situation based on HoloLens in any of the above-described embodiment, above-mentioned steps
S70 locks message in response to the above-mentioned open configuration that above-mentioned configuration script is sent, long-range to save above-mentioned AR program in HoloLens
Unity3D engineering.
Optionally, the accurate occlusion method of AR actual situation based on HoloLens in any of the above-described embodiment, it is above-mentioned
HoloLens can be replaced other intelligent glasses for having augmented reality function.
The present invention by HoloLens by using the technological means solution such as model of pre-production real world objects
Real world objects of having determined have the problem of gap when AR mutual occlusion in device software, and it is first after program operation to eliminate needs
The operation for first needing scanning circumstance etc. additional.
It is described further below with reference to technical effect of the attached drawing to design of the invention, specific structure and generation, with
It is fully understood from the purpose of the present invention, feature and effect.
Detailed description of the invention
Fig. 1 is Microsoft augmented reality HoloLens；
Fig. 2 is the flow chart of a preferred embodiment of the invention.
Specific embodiment
Multiple preferred embodiments of the invention are introduced below with reference to Figure of description, keep its technology contents more clear and just
In understanding.The present invention can be emerged from by many various forms of embodiments, and protection scope of the present invention not only limits
The embodiment that Yu Wenzhong is mentioned.
In the accompanying drawings, the identical component of structure is indicated with same numbers label, everywhere the similar component of structure or function with
Like numeral label indicates.The size and thickness of each component shown in the drawings are to be arbitrarily shown, and there is no limit by the present invention
The size and thickness of each component.Apparent in order to make to illustrate, some places suitably exaggerate the thickness of component in attached drawing.
As shown in Figure 1, Microsoft augmented reality HoloLens, is blocked using the solution of Spatial mapping technical solution and is asked
Topic.Pair of the data for the real world that Spatial mapping technology to the effect that utilizes sensor to return in Virtual Space
It answers position to create material, the occlusion effect of real world and virtual image is presented by the material of creation.But it can not be accurately positioned
Object space, size and profile into real world.Lead to the dummy object feelings that object blocks in by real world in this way
Occurs the local display of the partial occlusion of mistake or mistake under condition.Especially the object of real world creates material in device software
It is not covered by material after matter there are many gap, causes dummy object to be showed to come by the leakage of mistake, affect user experience.Separately
Outside, it using Spatial mapping technology, requires first to carry out a period of time using HoloLens after opening application program every time
Scanning circumstance operation.Scanning circumstance operation operates more troublesome with centainly technical.
Inventor by HoloLens by using the technological means solution such as model of pre-production real world objects
Real world objects of having determined have the problem of gap when AR mutual occlusion in device software, and it is first after program operation to eliminate needs
The operation for first needing scanning circumstance etc. additional.
As shown in Fig. 2, a preferred embodiment of the invention.The following steps are included:
S10, selected real-world object；
S20, modeling model above-mentioned real-world object in 3 d modeling software, and add visible material, will give birth to
At model save at the format that can import Unity3D editing machine；
S30, model import, and above-mentioned model is imported AR program Unity3D engineering；
S40, script edit write self-defined message script, collaboration script and configuration script；
S50, script load and model publication, are loaded into above-mentioned AR program Unity3D engineering for above-mentioned script, and will be above-mentioned
AR program Unity3D engineering is published to HoloLens operation；
S60, configuration configure the above-mentioned AR program Unity3D engineering being published in HoloLens, such as dotted line frame institute in Fig. 2
Show；
S70, preservation save above-mentioned AR program Unity3D engineering.
Optionally, 3 d modeling software include professional software and software with modeling function, it is preferable to use
Unity3D, the preservation format for the model being correspondingly generated are .fbx and .obj
Optionally, self-defined message script is named as customMessages240.cs, including sends pose message, obtains
Fetch bit appearance message, open position synchronization message, open configuration lock message, closes configuration lock message, sets at closed position configuration message
It is set to special transparent material message, cancels transparent material message, addition world's anchor point message, remove world's anchor point message.
Optionally, above-mentioned collaboration script is named as RealSend.cs, in response to above-mentioned collaboration script RealSend.cs
Object pose message is sent in Unity3D editing machine, HoloLens simultaneously operating model adjusts pose.
Optionally, above-mentioned configuration script is named as ConfigManager.cs, will be adjusted in response to above-mentioned configuration script
Good new position sends above-mentioned addition world anchor point message and is saved to HoloLens.
Optionally, as shown in dotted line frame in Fig. 2, above-mentioned steps S60 includes:
S61, adjustment model pose are rung when the model observed in HoloLens is not overlapped with above-mentioned real-world object
Script RealSend.cs should be cooperateed with to send pose message to HoloLens in upper, change function is used in Unity3D editing machine
The model pose in above-mentioned AR program Unity3D engineering can be adjusted；
S62, anchor point is saved, added in response to what configuration script ConfigManager.cs was sent comprising the above-mentioned of relevant parameter
Add world's anchor point message, using MixedRealityToolkit plug-in unit, world's anchor point of the long-range preservation model of HoloLens can
Selection of land, world's anchor point are defined as WorldAncher；
S63, replacement model material above-mentioned be set as special transparent material and disappear in response to what above-mentioned configuration script was sent
Breath, it is special transparent material that HoloLens, which remotely replaces model material,.It further, can be with using special transparent material
See the real world blocked, can not see that the dummy object blocked, preferably special transparent material are Occlusion.
For step S70, optionally, message is locked in response to the above-mentioned open configuration that above-mentioned configuration script is sent, it is long-range to protect
Deposit above-mentioned AR program Unity3D engineering.
In Fig. 2, replacement model material saves anchor point and adjustment model pose as remote operation.
The preferred embodiment of the present invention has been described in detail above.It should be appreciated that the ordinary skill of this field is without wound
The property made labour, which according to the present invention can conceive, makes many modifications and variations.Therefore, all technician in the art
Pass through the available technology of logical analysis, reasoning, or a limited experiment on the basis of existing technology under this invention's idea
Scheme, all should be within the scope of protection determined by the claims.
Claims (10)
1. a kind of accurate occlusion method of AR actual situation based on HoloLens, which is characterized in that the described method comprises the following steps:
S10, selected real-world object；
S20, modeling model the real-world object in 3 d modeling software, and add visible material, by generation
Model is saved into the format that can import Unity3D editing machine；
S30, model import, and the model is imported AR program Unity3D engineering；
S40, script edit write self-defined message script, collaboration script and configuration script；
S50, script load and engineering publication, are loaded into the AR program Unity3D engineering for the script, and by the AR journey
Sequence Unity3D engineering is published to the HoloLens operation；
S60, configuration configure the AR program Unity3D engineering being published in the HoloLens；
S70, preservation save the AR program Unity3D engineering.
2. the accurate occlusion method of AR actual situation based on HoloLens as described in claim 1, which is characterized in that described customized
Message script includes sending pose message, obtaining pose message, closed position configuration message, open position synchronization message, open
Configuration lock message closes configuration lock message, is set as special transparent material message, cancels transparent material message, the addition world
Anchor point message removes world's anchor point message.
3. the accurate occlusion method of AR actual situation based on HoloLens as claimed in claim 2, which is characterized in that the step
S60 includes:
S61, adjustment model pose, when the model observed in HoloLens object corresponding with real world is not overlapped
When, pose message is sent to the HoloLens in response to the collaboration script, described middle using described in change function adjustment
Model pose；
S62, save anchor point, in response to the configuration script send the addition world anchor point message comprising relevant parameter,
World's anchor point of the long-range preservation model of HoloLens；
S63, replacement model material, in response to being set as special transparent material message, institute described in configuration script transmission
Stating HoloLens and remotely replacing model material is special transparent material.
4. the accurate occlusion method of AR actual situation based on HoloLens as claimed in claim 3, which is characterized in that pass through the spy
Different transparent material, it can be seen that the real world blocked can not see the dummy object blocked.
5. the accurate occlusion method of AR actual situation based on HoloLens as claimed in claim 2, which is characterized in that in response to described
Collaboration script sends object pose message in the Unity3D editing machine, and the HoloLens simultaneously operating model adjusts position
Appearance.
6. the accurate occlusion method of AR actual situation based on HoloLens as claimed in claim 5, which is characterized in that in response to described
The new position adjusted is sent addition world anchor point message by configuration script, and the HoloLens is saved.
7. the accurate occlusion method of AR actual situation based on HoloLens as described in claim 1, which is characterized in that the three-dimensional is built
Mould software includes professional software and the software with modeling function.
8. the accurate occlusion method of AR actual situation based on HoloLens as claimed in claim 7, which is characterized in that described have is built
The software of mould function is Unity3D.
9. the accurate occlusion method of AR actual situation based on HoloLens as described in claim 1, which is characterized in that the step
S70 locks message in response to the open configuration that the configuration script is sent, remotely saves the AR program Unity3D engineering.
10. the accurate occlusion method of AR actual situation based on HoloLens as described in claim 1, which is characterized in that the format
Including .fbx and .obj.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811451850.8A CN109685887A (en) | 2018-11-30 | 2018-11-30 | A kind of accurate occlusion method of AR actual situation based on HoloLens |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811451850.8A CN109685887A (en) | 2018-11-30 | 2018-11-30 | A kind of accurate occlusion method of AR actual situation based on HoloLens |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN109685887A true CN109685887A (en) | 2019-04-26 |
Family
ID=66185167
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811451850.8A Pending CN109685887A (en) | 2018-11-30 | 2018-11-30 | A kind of accurate occlusion method of AR actual situation based on HoloLens |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109685887A (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110189407A (en) * | 2019-05-31 | 2019-08-30 | 东北大学 | A kind of human body three-dimensional reconstruction model system based on HOLOLENS |
| CN111124119A (en) * | 2019-12-19 | 2020-05-08 | 天津大学 | Building model presenting and interacting method based on virtual reality technology |
| CN116700693A (en) * | 2023-08-02 | 2023-09-05 | 北京格如灵科技有限公司 | Hololens anchor point positioning storage method, system, equipment and medium |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107330978A (en) * | 2017-06-26 | 2017-11-07 | 山东大学 | The augmented reality modeling experiencing system and method mapped based on position |
| CN107680165A (en) * | 2017-09-25 | 2018-02-09 | 中国电子科技集团公司第二十八研究所 | Computer operation table holography based on HoloLens shows and natural interaction application process |
| CN108351689A (en) * | 2015-10-30 | 2018-07-31 | 索尼移动通讯有限公司 | Use the exchange method and system of holographic display system |
-
2018
- 2018-11-30 CN CN201811451850.8A patent/CN109685887A/en active Pending
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108351689A (en) * | 2015-10-30 | 2018-07-31 | 索尼移动通讯有限公司 | Use the exchange method and system of holographic display system |
| CN107330978A (en) * | 2017-06-26 | 2017-11-07 | 山东大学 | The augmented reality modeling experiencing system and method mapped based on position |
| CN107680165A (en) * | 2017-09-25 | 2018-02-09 | 中国电子科技集团公司第二十八研究所 | Computer operation table holography based on HoloLens shows and natural interaction application process |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110189407A (en) * | 2019-05-31 | 2019-08-30 | 东北大学 | A kind of human body three-dimensional reconstruction model system based on HOLOLENS |
| CN111124119A (en) * | 2019-12-19 | 2020-05-08 | 天津大学 | Building model presenting and interacting method based on virtual reality technology |
| CN111124119B (en) * | 2019-12-19 | 2023-09-05 | 天津大学 | Building model presentation and interaction method based on virtual reality technology |
| CN116700693A (en) * | 2023-08-02 | 2023-09-05 | 北京格如灵科技有限公司 | Hololens anchor point positioning storage method, system, equipment and medium |
| CN116700693B (en) * | 2023-08-02 | 2023-10-27 | 北京格如灵科技有限公司 | Hololens anchor point positioning storage method, system, equipment and medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106355153B (en) | A kind of virtual objects display methods, device and system based on augmented reality | |
| US9613463B2 (en) | Augmented reality extrapolation techniques | |
| US10380803B1 (en) | Methods and systems for virtualizing a target object within a mixed reality presentation | |
| US20190180509A1 (en) | Apparatus and associated methods for presentation of first and second virtual-or-augmented reality content | |
| CN109685887A (en) | A kind of accurate occlusion method of AR actual situation based on HoloLens | |
| US20170119471A1 (en) | Augmented Reality Imaging System for Cosmetic Surgical Procedures | |
| CN107240319A (en) | A kind of interactive Scene Teaching system for the K12 stages | |
| US11302049B2 (en) | Preventing transition shocks during transitions between realities | |
| CN109696953B (en) | Virtual reality character display method and device and virtual reality equipment | |
| CN108668050A (en) | Video capture method and apparatus based on virtual reality | |
| KR20230042061A (en) | 3D conversations in an artificial reality environment | |
| WO2022055367A1 (en) | Method for emulating defocus of sharp rendered images | |
| CN107172415B (en) | A kind of VR holography integrated synchronous interactive exhibition system and its control method | |
| WO2018211103A1 (en) | Methods and systems for viewing and editing ar/vr computer-based designs allowing impaired vision simulation | |
| Lopez et al. | A playback tool for reviewing VR experiences | |
| KR20230103379A (en) | Method and apparatus for processing augmented reality | |
| CN110992474B (en) | Method for realizing time domain technology | |
| KR101893038B1 (en) | Apparatus and method for providing mapping pseudo hologram using individual video signal output | |
| CN106504063A (en) | A kind of virtual hair tries video frequency showing system on | |
| GB2536790A (en) | A mixed reality system and method for displaying data therein | |
| WO2016135450A1 (en) | A mixed reality system and method for displaying data therein | |
| WO2019166272A1 (en) | Methods, apparatus, systems, computer programs for enabling mediated reality | |
| CN108694707A (en) | Image de-noising method, device and equipment | |
| KR101859318B1 (en) | Video content production methods using 360 degree virtual camera | |
| CN110119204A (en) | The processing method of any VR/AR/MR device can be matched by editing a VR/AR/MR content |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |