CN105894584B - The method and apparatus that are interacted with actual environment under a kind of three-dimensional immersive environment - Google Patents
The method and apparatus that are interacted with actual environment under a kind of three-dimensional immersive environment Download PDFInfo
- Publication number
- CN105894584B CN105894584B CN201610237856.XA CN201610237856A CN105894584B CN 105894584 B CN105894584 B CN 105894584B CN 201610237856 A CN201610237856 A CN 201610237856A CN 105894584 B CN105894584 B CN 105894584B
- Authority
- CN
- China
- Prior art keywords
- environment
- user
- actual environment
- real
- dimensional immersive
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T19/00—Manipulating 3D models or images for computer graphics
- G06T19/006—Mixed reality
Landscapes
- Engineering & Computer Science (AREA)
- Computer Graphics (AREA)
- Computer Hardware Design (AREA)
- General Engineering & Computer Science (AREA)
- Software Systems (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Processing Or Creating Images (AREA)
Abstract
The invention discloses the method and apparatus interacted under a kind of three-dimensional immersive environment with actual environment, this method comprises: acquiring the real outdoor scene of the actual environment where user using picture pick-up device；Under three-dimensional immersive environment, collected real outdoor scene is shown to user in real time；The Overlapping display virtual application in the real outdoor scene for being shown to user.Real outdoor scene is shown by acquisition and to user in three-dimensional immersive environment, interact user with real world can rationally during experiencing three-dimensional immersive environment, virtual experience is carried out on the basis of not influencing real basic act, obtain better operating experience and environmental feedback, real outdoor scene is synthesized with virtual scene, makes immersion experience that more there is real-time and scalability.
Description
Technical field
The present invention relates to technical field of virtual reality, in particular to interacted under a kind of three-dimensional immersive environment with actual environment
Method and apparatus.
Background technique
Three-dimensional immersive environment is a kind of interactive three-dimensional dynamic vision of Multi-source Information Fusion and the system of entity behavior
Emulation, so that user be made to be immersed in the environment, has many characteristics, such as that Multi-Sensory, there are sense, interactivity, independences.With skill
The continuous development of art, emerges number of types of software application and the different hardware device of form on the market, but existing void
Quasi- real world devices are all to keep apart the three-dimensional immersive environment of building with actual environment, and user is experiencing three-dimensional immersive environment
During can not be interacted with real world.
Summary of the invention
In order to solve the problems, such as that user can not interact during experiencing three-dimensional immersive environment with real world, void is allowed
Quasi- application system is rationally interacted with real outdoor scene generation, and user is allow to carry out void on the basis of not influencing real basic act
Quasi- experience, the present invention provides the method and apparatus interacted under a kind of three-dimensional immersive environment with actual environment.
According to one aspect of the present invention, the present invention provides interact with actual environment under a kind of three-dimensional immersive environment
Method, comprising:
The real outdoor scene of the actual environment where user is acquired using picture pick-up device；
Under three-dimensional immersive environment, the real outdoor scene is shown to user in real time；
The Overlapping display virtual application in the real outdoor scene.
Wherein, the method also includes:
The virtual application of certain objects in pre-production actual environment；
When in the actual environment where some object appears in user, showing under three-dimensional immersive environment to user should
The corresponding virtual application of object.
Wherein, the method also includes:
The distance between each object and the user in user's visual range are measured using distance-measuring equipment；
The range information of each object is prompted the user under three-dimensional immersive environment.
Wherein, the method also includes:
Utilize the photo of picture pick-up device shooting actual environment；
The photo of the actual environment is shown to user in three-dimensional immersive environment.
Wherein, the method also includes:
The Weather information of actual environment is obtained in real time；
The weather changed in real time in three-dimensional immersive environment according to the Weather information of actual environment is shown.
Another aspect according to the present invention, the present invention provides what is interacted under a kind of three-dimensional immersive environment with actual environment
Device, including outdoor scene acquisition unit, outdoor scene display unit and application display unit；
The outdoor scene acquisition unit, for the real outdoor scene using the actual environment where picture pick-up device acquisition user；
The outdoor scene display unit, for showing that the outdoor scene acquisition is single to user in real time under three-dimensional immersive environment
The collected real outdoor scene of member；
The application display unit, for the Overlapping display virtual application in the real outdoor scene.
Wherein, described device further includes using production unit；
It is described to apply production unit, the virtual application for certain objects in pre-production actual environment；
The application display unit is also used to when in the actual environment where some object appears in user, in three-dimensional
The corresponding virtual application of the object is shown to user under immersive environment.
Wherein, described device further includes distance measuring unit；
The distance measuring unit, for using each object in distance-measuring equipment measurement user's visual range and between user
Distance；
The application display unit is also used to show the distance letter of each object to user under three-dimensional immersive environment
Breath.
Wherein, described device further includes photographing unit:
The photographing unit, for the photo using picture pick-up device shooting actual environment；
The application display unit is also used to show the photo of the actual environment to user in three-dimensional immersive environment.
Wherein, described device further includes weather display unit；
The weather display unit is believed for obtaining the Weather information of actual environment in real time according to the weather of actual environment
The weather that breath changes in real time in three-dimensional immersive environment is shown.
The beneficial effect of the embodiment of the present invention is: showing that reality is real by acquisition and to user in three-dimensional immersive environment
Scape interact user with real world can rationally during experiencing three-dimensional immersive environment, basic not influencing reality
Virtual experience is carried out on the basis of behavior, obtains better operating experience and environmental feedback.In a further preferred embodiment,
When user sees the jobbie in actual environment in three-dimensional immersive environment, the corresponding virtual application of Overlapping display or additional
Information synthesizes real outdoor scene with virtual scene, immersion experience is made more to have real-time and scalability.
Detailed description of the invention
Fig. 1 is the process of the method interacted under a kind of three-dimensional immersive environment provided in an embodiment of the present invention with actual environment
Figure；
Fig. 2 is the effect of the method interacted under a kind of three-dimensional immersive environment provided in an embodiment of the present invention with actual environment
Schematic diagram；
Fig. 3 is the structure of the device interacted under a kind of three-dimensional immersive environment provided in an embodiment of the present invention with actual environment
Schematic diagram.
Specific embodiment
To make the object, technical solutions and advantages of the present invention clearer, below in conjunction with attached drawing to embodiment party of the present invention
Formula is described in further detail.
Fig. 1 is the process of the method interacted under a kind of three-dimensional immersive environment provided in an embodiment of the present invention with actual environment
Figure.As shown in Figure 1, the method interacted under three-dimensional immersive environment provided in an embodiment of the present invention with actual environment includes:
Step S110: the real outdoor scene of the actual environment where user is acquired using picture pick-up device.
Step S120: under three-dimensional immersive environment, collected real outdoor scene is shown to user in real time.
For example, user, which wears virtual implementing helmet, experiences three-dimensional immersive environment, taken the photograph first with what is be mounted on the helmet
As the real outdoor scene of equipment acquisition, the virtual scene in virtual reality system is converted into real outdoor scene in real time, it then will be virtual
For application layout in reality system among real outdoor scene, user can be real during using the application of virtual reality system
When observe real outdoor scene, will not influence the real basic act of user, by the way that real outdoor scene is synthesized with virtual scene, make
Immersion experience more has real-time and scalability.
Step S130: the Overlapping display virtual application in real outdoor scene.Virtual application can use translucent display side
Formula is shown between human eye and real outdoor scene, and user still can obtain the letter of actual environment feedback when operating virtual application
Breath, display effect are as shown in Figure 2.Virtual application can also be fused together with the real outdoor scene of display, such as in real outdoor scene
There is a desk, the video playing application of a virtual display form on desk, to realize that virtual application and reality are real
The combination of scape.
Preferably, the method interacted under three-dimensional immersive environment provided in an embodiment of the present invention with actual environment further include:
The virtual application of certain objects in pre-production actual environment, when in the actual environment where some object appears in user,
The corresponding virtual application of the object is shown to user under three-dimensional immersive environment.
Such as the real-time introduction of tourist attractions is carried out using virtual reality device.It selects first several with representative in sight spot
Property scenery, corresponding each scenery makes a virtual application, for the scenery is introduced, using can be sound, figure
The forms such as piece, text, video.Then, the coordinate of each scenery is acquired, and these are judged according to the location information of user in real time
Whether scenery is in the visual field of user, when some scenery appears in the visual field of user, the corresponding application of the scenery is same
When be shown to user, user can not only see the scenery from virtual reality device, moreover it is possible to while seeing introduction to the scenery,
Grand famous mountains and great rivers is watched to enhance user, dense local conditions and customs is experienced, enjoys a trip to the immersions such as mysterious seabed Dragon Palace
Experience.Similar, the method interacted under three-dimensional immersive environment provided in an embodiment of the present invention with actual environment applies also for
Amusement game, video display news, astronomical geography, education, industrial maintenance, social communication etc. field.
Preferably, the method interacted under three-dimensional immersive environment provided in an embodiment of the present invention with actual environment further include:
Using in distance-measuring equipment measurement user's visual range each object and the distance between user, under three-dimensional immersive environment to
User prompts the range information of each object.
By the distance-measuring equipment such as laser range finder, infrared ambulator etc. being mounted in virtual reality, can measure
The distance of multiple objects in user's range of visibility, and the accurate distance values of user are fed back in 3D immersive environment.
Preferably, the method interacted under three-dimensional immersive environment provided in an embodiment of the present invention with actual environment further include:
Using the photo of picture pick-up device shooting actual environment, the photo of the actual environment is shown to user in three-dimensional immersive environment.
It is empty both to have can use the real outdoor scene building that picture pick-up device obtains in real time when experiencing three-dimensional immersive environment by user
The scene of quasi- reality system, also can use picture pick-up device by the camera applications in corresponding operating calling virtual reality system,
The photo of quick obtaining true environment records splendid moment.
Preferably, the method interacted under three-dimensional immersive environment provided in an embodiment of the present invention with actual environment further include:
The Weather information for obtaining actual environment in real time changes the day in three-dimensional immersive environment according to the Weather information of actual environment in real time
Gas is shown.
There are many modes that Weather information is shown in 3D immersive environment, such as can be believed according to the weather of actual environment
Cease the corresponding weather icon of real-time display；Alternatively, Weather information can be fused in the virtual scene constructed, such as it is in
In use virtual reality device, constructing a virtual office scenarios if begun to rain in reality can be used family
See that virtual office is also raining outside window, so that user be made to obtain the Weather information of actual environment.
Fig. 3 is the structure of the device interacted under a kind of three-dimensional immersive environment provided in an embodiment of the present invention with actual environment
Schematic diagram.As shown in figure 3, the device interacted under three-dimensional immersive environment provided in an embodiment of the present invention with actual environment includes real
Scape acquisition unit 310, outdoor scene display unit 320 and application display unit 330.
Outdoor scene acquisition unit 310 acquires the real outdoor scene of the actual environment where user using picture pick-up device.Outdoor scene is shown
Unit 320 shows the collected real outdoor scene of outdoor scene acquisition unit 310 to user in real time under three-dimensional immersive environment.Using
The Overlapping display virtual application in real outdoor scene of display unit 330.
The device that interacts with actual environment further includes under the three-dimensional immersive environment that a preferred embodiment of the invention provides
Using production unit.Using the virtual application of certain objects in production unit pre-production actual environment；When some object occurs
When in the actual environment where user, application display unit 330 shows the object pair to user under three-dimensional immersive environment
The virtual application answered.By the way that real outdoor scene is synthesized with virtual scene, make immersion experience that more there is real-time and expansion
Malleability
The device interacted under the three-dimensional immersive environment that another preferred embodiment of the present invention provides with actual environment also wraps
Include distance measuring unit.Distance measuring unit measures the distance between each object and user in user's visual range using distance-measuring equipment,
Application display unit 330 shows the range information of each object under three-dimensional immersive environment to user.User is by accordingly grasping
Make calling distance measuring unit, so that it may easily measure oneself at a distance from multiple objects in range of visibility, and in virtual application system
The accurate distance values of real time inspection in system.
The device interacted under the three-dimensional immersive environment that another preferred embodiment of the invention provides with actual environment also wraps
Include photographing unit.Photo of the photographing unit using picture pick-up device shooting actual environment, the three-dimensional immersion ring of application display unit 330
The photo of the actual environment is shown in border to user, records splendid moment.
The device interacted under the three-dimensional immersive environment that another preferred embodiment of the invention provides with actual environment also wraps
Include weather display unit.Weather display unit obtains the Weather information of actual environment in real time, according to the Weather information of actual environment
The weather changed in three-dimensional immersive environment in real time is shown, user is allow to understand the weather conditions of actual environment in real time.
The method and apparatus interacted under three-dimensional immersive environment provided by the invention with actual environment, the three-dimensional of building is sunk
Immersion environment is combined with actual environment, and the application under three-dimensional immersive environment not only can be used in user, can also be obtained in real time
The information of enchashment real environment, interacts with actual environment, so that user be made to obtain well the easily behaviour of virtual reality applications
Make experience and environmental feedback.
In conclusion the method and apparatus interacted under a kind of three-dimensional immersive environment provided by the invention with actual environment,
Compared with prior art, it has the advantages that
1, real outdoor scene is shown by acquisition and to user in three-dimensional immersive environment, immerse user in experience three-dimensional
It can rationally be interacted with real world during formula environment, Dummy is carried out on the basis of not influencing real basic act
It tests, obtains better operating experience and environmental feedback.
2, when user sees the jobbie in actual environment in three-dimensional immersive environment, Overlapping display is corresponding virtual
Using or additional information, real outdoor scene is synthesized with virtual scene, makes immersion experience more with real-time and extension
Property.
The foregoing is merely illustrative of the preferred embodiments of the present invention, is not intended to limit the scope of the present invention.It is all
Any modification, equivalent replacement, improvement and so within the spirit and principles in the present invention, are all contained in protection scope of the present invention
It is interior.
Claims (6)
1. a kind of method interacted under three-dimensional immersive environment with actual environment, which is characterized in that the described method includes:
The real outdoor scene of the actual environment where user is acquired using picture pick-up device；
Under three-dimensional immersive environment, the real outdoor scene is shown to user in real time；
The Overlapping display virtual application in the real outdoor scene；
The virtual application of certain objects in pre-production actual environment；
When in the actual environment where some object appears in user, the object is shown to user under three-dimensional immersive environment
Corresponding virtual application；
The distance between each object and the user in user's visual range are measured using distance-measuring equipment；
The range information of each object is prompted the user under three-dimensional immersive environment.
2. the method interacted under three-dimensional immersive environment as described in claim 1 with actual environment, which is characterized in that the side
Method further include:
Utilize the photo of picture pick-up device shooting actual environment；
The photo of the actual environment is shown to user in three-dimensional immersive environment.
3. the method interacted under three-dimensional immersive environment as claimed in claim 1 or 2 with actual environment, which is characterized in that institute
State method further include:
The Weather information of actual environment is obtained in real time；
The weather changed in real time in three-dimensional immersive environment according to the Weather information of actual environment is shown.
4. the device interacted under a kind of three-dimensional immersive environment with actual environment, which is characterized in that described device includes that outdoor scene is adopted
Collect unit, outdoor scene display unit and application display unit；
The outdoor scene acquisition unit, for the real outdoor scene using the actual environment where picture pick-up device acquisition user；
The outdoor scene display unit, for showing that the outdoor scene acquisition unit is adopted to user in real time under three-dimensional immersive environment
The real outdoor scene collected；
The application display unit, for the Overlapping display virtual application in the real outdoor scene；
Described device further includes using production unit；
It is described to apply production unit, the virtual application for certain objects in pre-production actual environment；
The application display unit is also used to immerse when in the actual environment where some object appears in user in three-dimensional
The corresponding virtual application of the object is shown to user under formula environment；
Described device further includes distance measuring unit；
The distance measuring unit, for using distance-measuring equipment measurement user's visual range in each object and user between away from
From；
The application display unit is also used to show the range information of each object to user under three-dimensional immersive environment.
5. the device interacted under three-dimensional immersive environment as claimed in claim 4 with actual environment, which is characterized in that the dress
Set further includes photographing unit:
The photographing unit, for the photo using picture pick-up device shooting actual environment；
The application display unit is also used to show the photo of the actual environment to user in three-dimensional immersive environment.
6. the device interacted under three-dimensional immersive environment with actual environment as described in claim 4 or 5, which is characterized in that institute
Stating device further includes weather display unit；
The weather display unit, it is real according to the Weather information of actual environment for obtaining the Weather information of actual environment in real time
When the weather that changes in three-dimensional immersive environment show.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610237856.XA CN105894584B (en) | 2016-04-15 | 2016-04-15 | The method and apparatus that are interacted with actual environment under a kind of three-dimensional immersive environment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610237856.XA CN105894584B (en) | 2016-04-15 | 2016-04-15 | The method and apparatus that are interacted with actual environment under a kind of three-dimensional immersive environment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN105894584A CN105894584A (en) | 2016-08-24 |
| CN105894584B true CN105894584B (en) | 2019-08-02 |
Family
ID=56703923
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610237856.XA Active CN105894584B (en) | 2016-04-15 | 2016-04-15 | The method and apparatus that are interacted with actual environment under a kind of three-dimensional immersive environment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105894584B (en) |
Families Citing this family (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107818540A (en) * | 2016-09-12 | 2018-03-20 | 北京易讯理想科技有限公司 | Display method of weather information and device based on augmented reality |
| CN106527682B (en) * | 2016-09-27 | 2020-11-10 | 北京小米移动软件有限公司 | Method and device for switching environment pictures |
| CN108391445B (en) * | 2016-12-24 | 2021-10-15 | 华为技术有限公司 | Virtual reality display method and terminal |
| CN107122052A (en) * | 2017-04-26 | 2017-09-01 | 深圳前海弘稼科技有限公司 | A kind of plantation apparatus control method and device based on VR equipment |
| CN107145237A (en) * | 2017-05-17 | 2017-09-08 | 上海森松压力容器有限公司 | Data measuring method and device in virtual scene |
| CN107665133A (en) * | 2017-09-04 | 2018-02-06 | 北京小鸟看看科技有限公司 | Wear the loading method of the Run-time scenario of display device and wear display device |
| TW201928876A (en) * | 2017-12-27 | 2019-07-16 | 宇博先進電子工業有限公司 | Image positioning method utilizing the same |
| CN108052206B (en) * | 2018-01-05 | 2021-08-13 | 重庆爱奇艺智能科技有限公司 | Video playing method and device and electronic equipment |
| CN109865289B (en) * | 2019-01-15 | 2020-01-31 | 特斯联（北京）科技有限公司 | real-scene environment entertainment system based on augmented reality technology and method thereof |
| CN111541889B (en) * | 2020-07-10 | 2020-10-20 | 南京新研协同定位导航研究院有限公司 | Method for using sight line triggering content by MR glasses |
| CN114089829B (en) * | 2021-10-13 | 2023-03-21 | 深圳中青宝互动网络股份有限公司 | Virtual reality's meta universe system |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101171565A (en) * | 2005-05-31 | 2008-04-30 | 菲利普莫里斯生产公司 | Virtual reality smoking system |
| CN104143212A (en) * | 2014-07-02 | 2014-11-12 | 惠州Tcl移动通信有限公司 | Reality augmenting method and system based on wearable device |
| CN204462541U (en) * | 2015-01-02 | 2015-07-08 | 靳卫强 | A kind of intelligent glasses realizing augmented reality |
| CN104977716A (en) * | 2014-04-02 | 2015-10-14 | 佳能株式会社 | Eyepiece-type display apparatus and display control method therefor |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| DE102009037835B4 (en) * | 2009-08-18 | 2012-12-06 | Metaio Gmbh | Method for displaying virtual information in a real environment |
| CN103140879B (en) * | 2010-09-30 | 2017-06-16 | 富士胶片株式会社 | Information presentation device, digital camera, head mounted display, projecting apparatus, information demonstrating method and information are presented program |
-
2016
- 2016-04-15 CN CN201610237856.XA patent/CN105894584B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101171565A (en) * | 2005-05-31 | 2008-04-30 | 菲利普莫里斯生产公司 | Virtual reality smoking system |
| CN104977716A (en) * | 2014-04-02 | 2015-10-14 | 佳能株式会社 | Eyepiece-type display apparatus and display control method therefor |
| CN104143212A (en) * | 2014-07-02 | 2014-11-12 | 惠州Tcl移动通信有限公司 | Reality augmenting method and system based on wearable device |
| CN204462541U (en) * | 2015-01-02 | 2015-07-08 | 靳卫强 | A kind of intelligent glasses realizing augmented reality |
Also Published As
| Publication number | Publication date |
|---|---|
| CN105894584A (en) | 2016-08-24 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105894584B (en) | The method and apparatus that are interacted with actual environment under a kind of three-dimensional immersive environment | |
| US11087555B2 (en) | Recognizing objects in a passable world model in augmented or virtual reality systems | |
| RU2621644C2 (en) | World of mass simultaneous remote digital presence | |
| CN105807931B (en) | A kind of implementation method of virtual reality | |
| US20190197791A1 (en) | Systems and methods for augmented reality representations of networks | |
| JP2021036449A (en) | System and method for augmented and virtual reality | |
| CN105005970B (en) | The implementation method and device of a kind of augmented reality | |
| CN105608746B (en) | A method of reality is subjected to Virtual Realization | |
| JP2018528509A (en) | Projected image generation method and apparatus, and mapping method between image pixel and depth value | |
| CN109865289B (en) | real-scene environment entertainment system based on augmented reality technology and method thereof | |
| CN105404441B (en) | The method for visualizing the surface data and panoramic image data of identical environment | |
| CN105824416B (en) | A method of by virtual reality technology in conjunction with cloud service technology | |
| Fabola et al. | Exploring the past with Google Cardboard | |
| CN109829977A (en) | Method, apparatus, electronic equipment and the medium in room are seen in virtual three-dimensional space | |
| KR101763636B1 (en) | Method for collaboration using head mounted display | |
| CN107908278B (en) | Virtual reality VR interface generation method and device | |
| CN109640070A (en) | A kind of stereo display method, device, equipment and storage medium | |
| CN107248194A (en) | A kind of CAE data three-dimensionals based on cloud computing show exchange method | |
| WO2018112695A1 (en) | Image display method and mobile terminal | |
| JP6043408B1 (en) | Simulated experience system, simulated experience method, portable device and simulated experience program | |
| CN106910251A (en) | Model emulation method based on AR and mobile terminal | |
| CN110444066A (en) | The insulation of electrical installation interacted based on holographic teacher and ring curtain tests training system | |
| Priestnall et al. | Virtual geographic environments | |
| CN105608726A (en) | Three-dimensional interactive chatting method | |
| KR20160136160A (en) | Virtual Reality Performance System and Performance Method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |