CN106774869B - Method and device for realizing virtual reality and virtual reality helmet - Google Patents
Method and device for realizing virtual reality and virtual reality helmet Download PDFInfo
- Publication number
- CN106774869B CN106774869B CN201611121033.7A CN201611121033A CN106774869B CN 106774869 B CN106774869 B CN 106774869B CN 201611121033 A CN201611121033 A CN 201611121033A CN 106774869 B CN106774869 B CN 106774869B
- Authority
- CN
- China
- Prior art keywords
- virtual reality
- scene
- current environment
- picture
- beginning
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
- G06F1/16—Constructional details or arrangements
- G06F1/1613—Constructional details or arrangements for portable computers
- G06F1/163—Wearable computers, e.g. on a belt
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
- G06F2203/01—Indexing scheme relating to G06F3/01
- G06F2203/012—Walk-in-place systems for allowing a user to walk in a virtual environment while constraining him to a given position in the physical environment
Abstract
The invention discloses a method for realizing virtual reality, which solves the problem of low immersion sense in the entering process of virtual reality experience by utilizing the existing VR equipment due to psychological suggestion of a user. The method comprises the following steps: displaying a first current environment live-action shot by a camera; superimposing a scene at the beginning of the virtual reality picture on the first current environment live view, wherein the first current environment live view and the scene at the beginning of the virtual reality picture have the same content; and weakening the first current environment live-action, and strengthening the scene at the beginning of the virtual reality picture until the virtual reality picture is completely displayed.
Description
Technical Field
The invention relates to the technical field of virtual reality, in particular to a method and a device for realizing virtual reality and a virtual reality helmet.
Background
Virtual Reality (VR) refers to the artificial creation of a three-dimensional environment by means of computer systems and sensor technology, in which every object, including the user himself, has a position and attitude relative to the system's coordinate system, and the view seen by the user is determined by the user's position and orientation of his head (eyes). The virtual reality creates a brand-new man-machine interaction state, brings more real and immersive experience by transferring all senses (vision, hearing, touch, smell and the like) of a user, and is widely applied to the fields of games, news media, social contact, sports events, movies, city planning, real estate and the like.
However, in the existing VR experience process, after a user wears a VR helmet, a display screen corresponding to human eyes immediately presents a three-dimensional virtual reality picture, and since the user sees completely different scenes before and after wearing the VR helmet, the instant scene switching can make the user mentally suggest that the user "enters a virtual environment", so that the immersion in the VR experience process is reduced.
From the analysis, the user is less immersed in the process of entering the virtual scene by using the existing virtual reality product due to the limitation of the subjective conditions of the user.
Disclosure of Invention
In view of this, embodiments of the present invention provide a method and an apparatus for implementing virtual reality, and a virtual reality helmet, which solve the problem of low immersion in an entry process of using an existing VR device for virtual reality experience due to psychological implication of a user.
The invention provides a method for realizing virtual reality, which comprises the following steps: displaying a first current environment live-action shot by a camera; superimposing a scene at the beginning of the virtual reality picture on the first current environment live view, wherein the first current environment live view and the scene at the beginning of the virtual reality picture have the same content; and weakening the first current environment live-action, and strengthening the scene at the beginning of the virtual reality picture until the virtual reality picture is completely displayed.
The invention also provides a device for realizing virtual reality, which comprises: the live-action display module is used for displaying a first current environment live-action shot by the camera; the first image processing module is used for overlaying a scene at the beginning of the virtual reality picture on a first current environment live-action, and the first current environment live-action and the scene at the beginning of the virtual reality picture have the same content; and the second image processing module is used for weakening the real scene of the first current environment and strengthening the scene at the beginning of the virtual reality picture until the virtual reality picture is completely displayed.
The invention also provides a virtual reality helmet, which comprises the device for realizing virtual reality.
According to the method and the device for realizing virtual reality and the virtual reality helmet, provided by the embodiment of the invention, after a user wears the VR helmet, a current environment real scene is displayed firstly, namely the current environment real scene is the same as a scene seen before the VR helmet is not worn; then, a scene at the beginning of the virtual reality picture with the same content as the current environment real scene is superposed on the current environment real scene until the virtual reality picture is completely displayed, the boundary between the real scene and the virtual reality scene is blurred, and in the whole process, a user cannot generate a psychological hint of entering the virtual reality scene, so that the immersion feeling is improved.
Drawings
Fig. 1 is a flowchart of a method for implementing virtual reality according to an embodiment of the present invention.
Fig. 2 is a schematic structural diagram of an apparatus for implementing virtual reality according to another embodiment of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Fig. 1 is a flowchart of a method for implementing virtual reality according to an embodiment of the present invention. As can be seen from the figure, the method comprises:
and step S101, displaying the first current environment real scene shot by the camera. The first current environment live view includes an ambient environment picture photographed in real time by the two cameras simulating human eyes.
The implementation process of this step may, for example, first, set up two cameras that correspond left and right eyes of people respectively on intelligent wearing equipment (such as VR helmet), this two cameras is used for simulating people's both eyes, and the direction of two cameras corresponds with the sight line direction of people's eyes. The VR helmet is worn by a user, the head of the user moves to drive the VR helmet to move, and then the cameras are driven to move correspondingly, so that the directions of the two cameras are consistent with the sight line direction of human eyes, the left camera and the right camera respectively shoot image sequences of a current environment real scene in real time according to the sight line direction of the left eye and the sight line direction of the right eye of the user, at any moment, an image can be obtained from the image sequence provided by the left camera to serve as a left image, an image is obtained from the image sequence provided by the right camera to serve as a right image, wherein the left image contains content seen by the left eye of the user, and the right image contains content seen by the right eye of the user. The left eye image and the right eye image at any moment are displayed through a display screen of intelligent wearable equipment (such as a VR helmet), and accordingly left eyes and right eyes of a user are presented.
Because the user just wears the VR helmet to see the current environment real scene, namely the scene is the same as the scene seen when the VR helmet is not worn, even if the image quality of the current real scene seen after wearing the VR helmet is different from that of the current real scene seen when the VR helmet is not worn, the user can not generate the psychological hint that the user enters a virtual unreal environment, which is like a myopic person, and after taking off the glasses, although the picture in front of the eyes becomes fuzzy, the psychological hint that the surrounding environment becomes unreal can not be generated. Therefore, psychological hint of the user is avoided, and the immersion sense in the experience process is improved.
Step S102, a scene at the beginning of the virtual reality picture is superposed on the current environment real scene, and the first current environment real scene and the scene at the beginning of the virtual reality picture have the same content.
The virtual reality screen refers to image information of a virtual reality model presented by using a virtual reality technology, for example, a left view and a right view of the virtual reality model. The scene at the beginning of the virtual reality picture refers to a plurality of frames of images at the beginning of the virtual reality picture, and the images can be displayed at the entrance of a virtual reality model. In this case, the fact that the current environment real scene is the same as the scene content at the beginning of the virtual reality screen means that the layout at the entrance of the real experience place is the same as the layout at the entrance of the virtual reality model. Therefore, by superposing the scene with the same content at the beginning of the virtual reality picture on the current environment live view, the boundary of the virtual scene entering from the real scene can be blurred, and the immersion sense in the virtual reality experience process is further improved.
The execution process of this step may be, for example, superimposing the left view corresponding to the virtual scene model onto the left image captured by the camera, and superimposing the right view corresponding to the virtual scene model onto the right image captured by the camera, so as to generate the fusion scene. In the specific superposition process, the fusion of the virtual model and the real scene can be guided by adopting the level information of the real scene, namely the depth of field information, so as to ensure that the virtual model is put into the real scene more reasonably. The overlay process may be implemented by using an augmented reality technology in the prior art, which is not described herein again.
In one embodiment, the superimposing includes any one of full superimposing, partial superimposing, stepwise superimposing. The full-superimposition is to superimpose all the contents of a scene at the beginning of a virtual reality screen on a real scene at a time, and is similar to augmented reality. The partial superimposition means that the content in the scene at the beginning of the virtual reality picture is divided into several parts, and the parts are superimposed one by one on the real scene in sequence, where the parts may be objects in the scene, for example. The gradual superposition refers to a scene starting from a shallow-to-deep superposed virtual reality picture on a real scene.
In one embodiment, the image quality of the current environmental live view is the same as the image quality of the virtual reality image. The image quality of the real scene shot by the camera is set to be the same as that of the preset virtual reality picture, so that the visual difference brought to the user by the switching process can be furthest blurred in the process of overlapping the real scene and the virtual scene, and the immersion feeling in the stage of entering the virtual reality scene is further improved.
In one embodiment, the image quality includes, but is not limited to, one or more of resolution, fluency, size, brightness.
Step S103, weakening the first current environment real scene, and strengthening the scene at the beginning of the virtual reality picture until the virtual reality picture is completely displayed. The weakening process and the strengthening process may be instantaneous or may be gradual.
According to the method for realizing the virtual reality, provided by the embodiment of the invention, the user firstly sees the real scene of the current environment (namely the entrance of the real experience field) after wearing the VR helmet, and compared with the prior art that the user directly shows the completely different virtual reality scene without wearing the VR helmet after wearing the VR helmet, the psychological hint of entering the virtual environment is avoided, and the immersion in the experience process is improved. Meanwhile, a mode of overlapping virtual reality scenes with the same content on the current environment live-action is adopted, so that the transition from the live-action to the virtual reality scenes is realized, the boundary of the scene transition process is blurred, the visual difference brought to the user by the transition process is reduced, and the immersion sense in the experience process is further improved.
The method for implementing virtual reality as shown in fig. 1 is described below by a specific application process.
It is not assumed that the image quality of the real scene seen by the naked eye of the user is a, the image quality of the real scene seen by the camera after wearing the VR headset is B, and the image quality of the virtual reality picture presented by the VR headset is C, wherein A, B, C includes one or more of parameters describing the image quality, such as resolution, fluency, size, brightness, and the like.
Early preparation: constructing a virtual reality model, and forming virtual reality by adopting a virtual reality technology, wherein the image quality of a virtual reality picture is B; adjusting a camera of the virtual reality helmet in advance to meet the condition that B is equal to C; the entrance and the exit of a place where a user experiences virtual reality are arranged according to the entrance and the exit of a virtual reality model respectively, and the beginning and the end of the virtual reality correspond to the entrance and the exit of the virtual reality model respectively.
The experience process comprises the following steps:
a user enters an entrance of a virtual reality experience field to see a real entrance scene, and the image quality of a picture seen by human eyes is A; wear VR virtual reality helmet, see the scene picture of entrance through the camera, the picture quality at this moment is B. The resolution of the camera can be artificially set to a quantitative value within a certain range, and the resolution of human eyes can change along with external environmental conditions due to distribution of photosensitive cells and defects of the photosensitive cells, so that the A and the B are different usually. Even so, because before and after wearing the VR helmet, the content that people's eyes see is the same, though there is a difference in picture quality, the user still feels psychologically "i still are in the real environment", similar to the sun suddenly being shaded, or a myopic person takes off glasses.
The method includes the steps that a scene at the beginning of a virtual reality picture is superposed on a scene at an entrance shot by a camera, the image quality of the scene at the beginning is C, and the image quality C is equal to the image quality B of the scene at the entrance shot by the camera. The transition from a real scene to a virtual reality picture is realized through the picture superposition process, the boundary between the real scene and the virtual reality picture is blurred, the visual impact brought to human eyes by the transition process is reduced, and the immersion feeling is improved. Meanwhile, under the condition that B is equal to C, the transition process is smoother, and the immersion feeling is improved to the maximum extent.
According to the method for realizing the virtual reality, the problem of low immersion sense in the entering stage of the virtual reality experience process caused by the psychological hint of the user is solved, and the immersion sense can be enhanced by adopting the process opposite to the entering process in the exiting stage of the virtual reality experience process.
In one embodiment, the method for implementing virtual reality as shown in fig. 1 further includes:
and step S104, superposing a second current environment real scene on the scene at the end of the virtual reality picture, wherein the content of the scene at the end of the virtual reality picture is the same as that of the second current environment real scene.
The scene at the end of the virtual reality picture refers to a few frames of images at the end of the virtual reality picture, which are presented, for example, as pictures at the exit of the virtual reality model. In this case, the current environment real scene is the same as the scene content at the end of the virtual reality screen, which means that the layout at the exit of the real experience field is the same as the layout at the exit of the virtual reality model.
In one embodiment, the first current environmental real estate and the second current environmental real estate are the same or different in content.
And step S105, weakening the scene at the end of the virtual reality picture, and strengthening the second current environment real scene until the second current environment real scene is completely displayed. Thus, when the user takes off the VR headset, the real scene is the same as the scene before the VR headset is taken off, and even if there is a difference in image quality, the user does not generate a psychological hint that the real environment is the virtual environment just before. Corresponding to the execution of step S101, this is equivalent to the myopic person wearing glasses again, and although the view becomes clear, no "environment unreal" hint is generated psychologically.
According to the method for realizing the virtual reality, the same principle and the opposite process are adopted in the entering stage and the leaving stage of the virtual reality experience process, and the immersion sense of the whole experience process is improved.
Those skilled in the art will appreciate that although the steps performed during the exit phase of the virtual reality experience process are not limited in detail, all the features that occur during the exit process are the same as or corresponding to those of the entry process.
Fig. 2 is a schematic structural diagram of an apparatus for implementing virtual reality according to another embodiment of the present invention. As can be seen from the figure, the apparatus comprises:
and the live-action display module 21 is used for displaying the first current environment live-action shot by the camera. In order to realize that the camera simulates human eyes to collect the real-scene information, the camera is required to collect the real-scene information according to the direction of the human eye sight, so that an eye sight tracking module is required to be installed inside the VR helmet to track the sight change, and meanwhile, a processor inside the VR helmet can respectively adjust the viewing angles of the left camera and the right camera according to the binocular sight change parameters.
The first image processing module 22 is configured to superimpose a scene at the beginning of the virtual reality image on a first current environmental real scene, where the first current environmental real scene and the scene at the beginning of the virtual reality image have the same content.
The second image processing module 23 is configured to weaken the first current environment real scene, and strengthen the scene at the beginning of the virtual reality picture until the virtual reality picture is completely displayed.
According to the method for realizing the virtual reality, the problem of low immersion sense in the entering stage of the virtual reality experience process caused by the psychological hint of the user is solved.
In one embodiment, the first image processing module 22 is further configured to superimpose a second current environmental real scene on the scene at the end of the virtual reality picture, where the scene at the end of the virtual reality picture has the same content as the second current environmental real scene; the second image processing module 23 is further configured to weaken a scene at the end of the virtual reality image, and strengthen the second current environment real scene until the second current environment real scene is completely displayed.
According to the method for realizing the virtual reality, the same principle and the opposite process are adopted in the entering stage and the leaving stage of the virtual reality experience process, and the immersion sense of the whole experience process is improved.
The invention also provides a virtual reality helmet which comprises a device for realizing virtual reality as shown in figure 2.
The above description is only for the purpose of illustrating the preferred embodiments of the present invention and is not to be construed as limiting the invention, and any modifications, equivalents and the like that are within the spirit and principle of the present invention are included in the present invention.
Claims (7)
1. A method for implementing virtual reality, comprising:
displaying a first current environment live-action shot by a camera;
completely superposing scenes at the beginning of the virtual reality picture on the first current environment live view, wherein the first current environment live view and the scenes at the beginning of the virtual reality picture have the same content; the superimposing of the scene at the beginning of the virtual reality picture on the live view of the first current environment comprises superimposing a left view corresponding to a virtual scene model onto a left image shot by the camera and superimposing a right view corresponding to the virtual scene model onto a right image shot by the camera;
weakening the first current environment live-action, and strengthening the scene at the beginning of the virtual reality picture until the virtual reality picture is completely displayed; and
completely superposing a second current environment live-action on a scene ending the virtual reality picture, wherein the content of the scene ending the virtual reality picture is the same as that of the second current environment live-action;
and weakening the scene at the end of the virtual reality picture, and strengthening the second current environment real scene until the second current environment real scene is completely displayed.
2. A method of implementing virtual reality as claimed in claim 1, wherein the overlay comprises any one of a full overlay, a partial overlay, a step-wise overlay.
3. A method of implementing virtual reality as claimed in claim 1, wherein the first and second current environmental scenes are the same or different in content.
4. The method of claim 1, wherein the first current environmental real-world scene and/or the second current environmental real-world scene have the same image quality as the virtual reality screen.
5. The method of claim 1, wherein the image quality includes but is not limited to one or more of resolution, fluency, size, and brightness.
6. An apparatus for implementing virtual reality, comprising:
the live-action display module is used for displaying a first current environment live-action shot by the camera;
the first image processing module is used for completely superposing scenes at the beginning of the virtual reality picture on the first current environment real scene, and the first current environment real scene and the scenes at the beginning of the virtual reality picture have the same content; the superimposing of the scene at the beginning of the virtual reality picture on the live view of the first current environment comprises superimposing a left view corresponding to a virtual scene model onto a left image shot by the camera and superimposing a right view corresponding to the virtual scene model onto a right image shot by the camera; completely superposing a second current environment live-action on a scene ending the virtual reality picture, wherein the content of the scene ending the virtual reality picture is the same as that of the second current environment live-action;
the second image processing module is used for weakening the live view of the first current environment and strengthening the scene at the beginning of the virtual reality picture until the virtual reality picture is completely displayed; and weakening the scene at the end of the virtual reality picture, and strengthening the second current environment real scene until the second current environment real scene is completely displayed.
7. A virtual reality helmet comprising the apparatus for realizing virtual reality of claim 6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611121033.7A CN106774869B (en) | 2016-12-08 | 2016-12-08 | Method and device for realizing virtual reality and virtual reality helmet |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611121033.7A CN106774869B (en) | 2016-12-08 | 2016-12-08 | Method and device for realizing virtual reality and virtual reality helmet |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN106774869A CN106774869A (en) | 2017-05-31 |
| CN106774869B true CN106774869B (en) | 2020-05-19 |
Family
ID=58881468
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201611121033.7A Active CN106774869B (en) | 2016-12-08 | 2016-12-08 | Method and device for realizing virtual reality and virtual reality helmet |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106774869B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114442814B (en) * | 2022-03-31 | 2022-09-16 | 灯影科技有限公司 | Cloud desktop display method, device, equipment and storage medium |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105955456A (en) * | 2016-04-15 | 2016-09-21 | 深圳超多维光电子有限公司 | Virtual reality and augmented reality fusion method, device and intelligent wearable equipment |
| CN105992986A (en) * | 2014-01-23 | 2016-10-05 | 索尼公司 | Image display device and image display method |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104102678B (en) * | 2013-04-15 | 2018-06-05 | 腾讯科技（深圳）有限公司 | The implementation method and realization device of augmented reality |
| CN103455982A (en) * | 2013-08-31 | 2013-12-18 | 四川川大智胜软件股份有限公司 | Airport scene monitoring vision enhancing method based on virtual-real fusion |
| CN105791977B (en) * | 2016-02-26 | 2019-05-07 | 北京视博云科技有限公司 | Virtual reality data processing method, equipment and system based on cloud service |
-
2016
- 2016-12-08 CN CN201611121033.7A patent/CN106774869B/en active Active
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105992986A (en) * | 2014-01-23 | 2016-10-05 | 索尼公司 | Image display device and image display method |
| CN105955456A (en) * | 2016-04-15 | 2016-09-21 | 深圳超多维光电子有限公司 | Virtual reality and augmented reality fusion method, device and intelligent wearable equipment |
Non-Patent Citations (1)
| Title |
|---|
| 颠覆重构一切的VR 到底是什么鬼？;彭顺丰;《声屏世界 广告人》;20160930(第9期);第38页第1节第1-10段 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN106774869A (en) | 2017-05-31 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| EP3035681B1 (en) | Image processing method and apparatus | |
| CN106157359B (en) | Design method of virtual scene experience system | |
| KR101995958B1 (en) | Apparatus and method for image processing based on smart glass | |
| US20170301137A1 (en) | Method, apparatus, and smart wearable device for fusing augmented reality and virtual reality | |
| US20120146894A1 (en) | Mixed reality display platform for presenting augmented 3d stereo image and operation method thereof | |
| CN109246463B (en) | Method and device for displaying bullet screen | |
| US20170195664A1 (en) | Three-dimensional viewing angle selecting method and apparatus | |
| CN106413829A (en) | Image encoding and display | |
| CN106598252A (en) | Image display adjustment method and apparatus, storage medium and electronic device | |
| CN104246688A (en) | Display apparatus and display control method | |
| KR20130097014A (en) | Expanded 3d stereoscopic display system | |
| WO2017204581A1 (en) | Virtual reality system using mixed reality, and implementation method therefor | |
| CN110084891B (en) | Color adjusting method of AR glasses and AR glasses | |
| JP5464130B2 (en) | Information display system, apparatus, method and program | |
| US20190109938A1 (en) | Message display method according to event occurrence in vr device and apparatus therefor | |
| CN108710206A (en) | A kind of method and apparatus of anti-dazzle and visual fatigue applied to VR displays | |
| US20190347864A1 (en) | Storage medium, content providing apparatus, and control method for providing stereoscopic content based on viewing progression | |
| CN109799899B (en) | Interaction control method and device, storage medium and computer equipment | |
| CN105208370B (en) | Display and calibration method of virtual-reality device | |
| CN106791769A (en) | Virtual reality realization method and system | |
| CN109901290A (en) | The determination method, apparatus and wearable device of watching area | |
| US9628770B2 (en) | System and method for stereoscopic 3-D rendering | |
| CN106774869B (en) | Method and device for realizing virtual reality and virtual reality helmet | |
| US20190281280A1 (en) | Parallax Display using Head-Tracking and Light-Field Display | |
| CN113941138A (en) | AR interaction control system, device and application |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |