CN112558906A - Display control method and system with imaging distance, storage medium and VR equipment thereof - Google Patents
Display control method and system with imaging distance, storage medium and VR equipment thereof Download PDFInfo
- Publication number
- CN112558906A CN112558906A CN202011453419.4A CN202011453419A CN112558906A CN 112558906 A CN112558906 A CN 112558906A CN 202011453419 A CN202011453419 A CN 202011453419A CN 112558906 A CN112558906 A CN 112558906A
- Authority
- CN
- China
- Prior art keywords
- glasses
- wearer
- display screen
- image
- front side
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000003384 imaging method Methods 0.000 title claims abstract description 44
- 238000000034 method Methods 0.000 title claims abstract description 26
- 239000011521 glass Substances 0.000 claims abstract description 349
- 230000000007 visual effect Effects 0.000 claims abstract description 26
- 238000004590 computer program Methods 0.000 claims description 7
- 230000004438 eyesight Effects 0.000 claims description 2
- 238000004891 communication Methods 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 230000001747 exhibiting effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
- G06F3/1454—Digital output to display device ; Cooperation and interconnection of the display device with other functional units involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Controls And Circuits For Display Device (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The invention provides a display control method and system with imaging distance, a storage medium and VR equipment thereof, comprising: acquiring an eye image of a VR glasses wearer by using a camera on the inner side of the VR glasses; obtaining the distance relationship between the eyes of a VR glasses wearer and a display screen on the outer front side surface of the VR glasses; and obtaining the imaging distance of the eyes of the VR glasses wearer relative to the surface of the display screen. The invention can ensure that the glasses image observed by external personnel is visually positioned at the actual glasses space position of the VR glasses wearer, and the visual effect is better and vivid.
Description
Technical Field
The present invention relates to VR glasses, and in particular, to a display control method and system having an imaging distance, a storage medium, and a VR device thereof.
Background
VR glasses isolate the wearer's eyes from the external real world environment in order to provide an immersive experience. However, the eyes and their catch of the VR glasses wearer are not visible to the person in the external real world environment. However, the users of the VR glasses cannot know the gaze of each other, and the VR glasses become an obstacle to gaze communication.
Disclosure of Invention
In view of the drawbacks of the prior art, it is an object of the present invention to provide a display control method and system having an imaging distance, a storage medium, and a VR device thereof.
According to the present invention, there is provided a display control method having an imaging distance, comprising:
a step of acquiring an eye image of a wearer: acquiring an eye image of a VR glasses wearer by using a camera on the inner side of the VR glasses;
the wearer eye image display step: and displaying real-time eye images of VR glasses wearers obtained by using cameras on the inner sides of the VR glasses in real time according to the imaging distance on a display screen on the outer front side surface of the VR glasses.
Preferably, in the step of displaying the eye images of the wearer, the real-time eye images of the VR glasses wearer obtained in the step of obtaining the eye images of the wearer are displayed on a display screen on the front side surface of the outside of the VR glasses after being subjected to left-right mirror image turning processing.
The invention provides a method for controlling a plurality of virtual characters, which comprises the following steps:
a display screen for displaying the eye image of the first VR glasses wearer on the outer front side surface of the first VR glasses by the display control method with the imaging distance;
enabling a camera of a second VR glasses to acquire an image of a real environment of a display screen containing the outer front side surface of the first VR glasses, so as to acquire eye information of a wearer of the first VR glasses, and displaying the image of the real environment of the display screen containing the outer front side surface of the first VR glasses to the wearer of the second VR glasses;
a display screen for displaying the eye image of the second VR glasses wearer on the outer front side surface of the second VR glasses by the second VR glasses through the display control method with the imaging distance;
enabling a camera of a first VR glasses to acquire an image of a real environment of a display screen containing the outer front side surface of a second VR glasses, so as to acquire eye information of a wearer of the second VR glasses, and displaying the image of the real environment of the display screen containing the outer front side surface of the second VR glasses to the wearer of the first VR glasses;
the first VR glasses prompt for the first VR glasses wearer to perform a prompting action on the display screen of the exterior frontside surface of the second VR glasses that maintains the gaze point in the viewed image of the real environment, the second VR glasses prompt for the second VR glasses wearer to perform a prompting action on the display screen of the exterior frontside surface of the first VR glasses that maintains the gaze point in the viewed image of the real environment; when a first VR glasses wearer and a second VR glasses wearer respectively confirm that prompt actions of first VR glasses and second VR glasses are finished, a first virtual character corresponding to the first VR glasses wearer and a second virtual character corresponding to the second VR glasses wearer are created in a virtual scene, visual lines of eyes of the first virtual character and the second virtual character are respectively controlled according to eye spirit information of the first VR glasses wearer and the second VR glasses wearer, and then under the condition that the visual lines are not changed, the spatial positions of the first virtual character and the second virtual character in the virtual scene are moved, so that the visual lines of the eyes of the first virtual character and the second virtual character are overlapped.
Preferably, after the line of sight of the eyes of the first virtual character and the second virtual character is overlapped, the relative spatial positions of the first virtual character and the second virtual character in the virtual scene are fixed, and the eye spirit of the first virtual character and the eye spirit of the second virtual character are synchronously adjusted according to the eye images of the first VR glasses wearer and the second VR glasses wearer respectively.
According to the present invention, there is provided a display control system having an imaging distance, comprising:
a wearer eye image acquisition module: acquiring an eye image of a VR glasses wearer by using a camera on the inner side of the VR glasses;
adjusting the spatial position: according to the depth information in the eye image, acquiring the distance between a camera on the inner side of the VR glasses and the eyes of a VR glasses wearer; obtaining the distance relation between the eyes of a VR glasses wearer and the display screen on the outer front side surface of the VR glasses according to the known distance relation between the display screen on the outer front side surface of the VR glasses and the cameras on the inner sides of the VR glasses;
a depth image generation step: obtaining the imaging distance of the eyes of the VR glasses wearer relative to the surface of the display screen according to the distance relationship between the eyes of the VR glasses wearer and the display screen on the outer front side surface of the VR glasses; the wearer eye image display module: and displaying real-time eye images of VR glasses wearers obtained by using cameras on the inner sides of the VR glasses in real time according to the imaging distance on a display screen on the outer front side surface of the VR glasses.
Preferably, in the wearer eye image display module, the real-time eye image of the VR glasses wearer acquired by the wearer eye image acquisition module is displayed on a display screen on the front side surface of the outside of the VR glasses after being subjected to left-right mirror image turning processing.
According to the present invention, there is provided a control system for a plurality of virtual characters, comprising:
a display screen for enabling the first VR glasses to display an eye image of a wearer of the first VR glasses on an outer front side surface of the first VR glasses through the display control system with the imaging distance;
enabling a camera of a second VR glasses to acquire an image of a real environment of a display screen containing the outer front side surface of the first VR glasses, so as to acquire eye information of a wearer of the first VR glasses, and displaying the image of the real environment of the display screen containing the outer front side surface of the first VR glasses to the wearer of the second VR glasses;
a display screen for enabling the second VR glasses to display the eye image of the wearer of the second VR glasses on the outer front side surface of the second VR glasses through the display control system with the imaging distance;
enabling a camera of a first VR glasses to acquire an image of a real environment of a display screen containing the outer front side surface of a second VR glasses, so as to acquire eye information of a wearer of the second VR glasses, and displaying the image of the real environment of the display screen containing the outer front side surface of the second VR glasses to the wearer of the first VR glasses;
the first VR glasses prompt for the first VR glasses wearer to perform a prompting action on the display screen of the exterior frontside surface of the second VR glasses that maintains the gaze point in the viewed image of the real environment, the second VR glasses prompt for the second VR glasses wearer to perform a prompting action on the display screen of the exterior frontside surface of the first VR glasses that maintains the gaze point in the viewed image of the real environment; when a first VR glasses wearer and a second VR glasses wearer respectively confirm that prompt actions of first VR glasses and second VR glasses are finished, a first virtual character corresponding to the first VR glasses wearer and a second virtual character corresponding to the second VR glasses wearer are created in a virtual scene, visual lines of eyes of the first virtual character and the second virtual character are respectively controlled according to eye spirit information of the first VR glasses wearer and the second VR glasses wearer, and then under the condition that the visual lines are not changed, the spatial positions of the first virtual character and the second virtual character in the virtual scene are moved, so that the visual lines of the eyes of the first virtual character and the second virtual character are overlapped.
Preferably, after the line of sight of the eyes of the first virtual character and the second virtual character is overlapped, the relative spatial positions of the first virtual character and the second virtual character in the virtual scene are fixed, and the eye spirit of the first virtual character and the eye spirit of the second virtual character are synchronously adjusted according to the eye images of the first VR glasses wearer and the second VR glasses wearer respectively.
According to the present invention, there is provided a computer-readable storage medium storing a computer program which, when executed by a processor, implements the steps of the display control method with imaging distance or the steps of the control method of a plurality of virtual persons.
According to the invention, the VR device comprises the computer readable storage medium storing the computer program, or comprises the display control system with the imaging distance, or comprises the control systems of the virtual characters.
Compared with the prior art, the invention has the following beneficial effects:
the invention can enable people outside the VR glasses to watch the eye images of the VR glasses wearer.
The invention can ensure that the glasses image observed by external personnel is visually positioned at the actual glasses space position of the VR glasses wearer, and the visual effect is better and vivid.
The virtual character eye contact virtual glasses can adjust the relative spatial position between the virtual characters to be consistent with the spatial position between the corresponding VR glasses, so that the eye contact of the virtual characters can be further conveniently communicated, and the eye contact communication between VR glasses wearers can be indirectly realized.
Drawings
Other features, objects and advantages of the invention will become more apparent upon reading of the detailed description of non-limiting embodiments with reference to the following drawings:
fig. 1 is a schematic diagram of a first VR glasses wearer a and a second VR glasses wearer B overlapping their respective visual lines in a real environment, and the first virtual character a and the second virtual character B have no overlapping visual lines in a virtual scene.
Fig. 2 is a schematic diagram illustrating the first virtual character a and the second virtual character B adjusted to overlap their line of sight in the virtual scene based on fig. 1.
FIG. 3 is a flow chart of the method steps of the present invention.
Fig. 2 only shows a two-dimensional illustration, and the skilled person understands that in practice the overlap between two lines of sight is performed in three dimensions.
Arrows in fig. 1 and 2 indicate the viewing angle directions.
Fig. 4 is a schematic structural view of VR glasses illustrating the position 100 of the external front side surface of the VR glasses.
Detailed Description
The present invention will be described in detail with reference to specific examples. The following examples will assist those skilled in the art in further understanding the invention, but are not intended to limit the invention in any way. It should be noted that it would be obvious to those skilled in the art that various changes and modifications can be made without departing from the spirit of the invention. All falling within the scope of the present invention.
In fig. 1 and 2, a rectangular frame a represents a first VR glasses (wearer), a rectangular frame B represents a second VR glasses (wearer), an oval a represents a first virtual character, and an oval B represents a second virtual character.
As shown in fig. 3, a display control method with an imaging distance according to the present invention includes:
a step of acquiring an eye image of a wearer: acquiring an eye image of a VR glasses wearer by using a camera on the inner side of the VR glasses; in the prior art, the VR glasses can know the gaze point of the wearer according to the collected eye images, and accordingly, the step can be realized with reference. In particular, the glasses image with depth information may be obtained by a depth camera, such as a structured light camera, a binocular stereo vision camera, a light time of flight camera, a light field camera. The depth camera takes a photo.
Adjusting the spatial position: according to the depth information in the eye image, acquiring the distance between a camera on the inner side of the VR glasses and the eyes of a VR glasses wearer; obtaining the distance relation between the eyes of a VR glasses wearer and the display screen on the outer front side surface of the VR glasses according to the known distance relation between the display screen on the outer front side surface of the VR glasses and the cameras on the inner sides of the VR glasses;
a depth image generation step: and obtaining the imaging distance of the eyes of the VR glasses wearer relative to the surface of the display screen according to the distance relationship between the eyes of the VR glasses wearer and the display screen on the outer front side surface of the VR glasses. For a wearer of one VR glasses, the step of obtaining the eye image of the wearer, the step of adjusting the spatial position and the step of generating the depth image are firstly executed, and after the execution is finished, the imaging distance of the eyes of the wearer of the VR glasses relative to the surface of the display screen is obtained. Then, in the routine use of the VR glasses, the wearer eye image exhibiting step is performed without performing the wearer eye image acquiring step, the spatial position adjusting step, the depth image generating step each time the VR glasses are used.
The wearer eye image display step: and displaying real-time eye images of VR glasses wearers obtained by using cameras on the inner sides of the VR glasses in real time according to the imaging distance on a display screen on the outer front side surface of the VR glasses. Specifically, the back of the display screen is connected to the front surface of the outer portion of the VR glasses, so that the display screen is located at the position right in front of the eyes of the wearer, the orientation of the front of the display screen is coaxial or parallel to the orientation of the VR glasses, and the front of the display screen can be seen by people outside the VR glasses due to the fact that the front of the display screen is not shielded, for example, people who do not wear the VR glasses or guardians of children who wear the VR glasses, and then the eyes of the VR glasses wearer are indirectly seen. The camera captures a video.
Preferably, in the step of displaying the eye images of the wearer, the real-time eye images of the VR glasses wearer obtained in the step of obtaining the eye images of the wearer are displayed on a display screen on the front side surface of the outside of the VR glasses after being subjected to left-right mirror image turning processing. In this way, the left and right eyes in the eye image are distributed in accordance with the left and right eyes of the wearer.
The invention provides a method for controlling a plurality of virtual characters, which comprises the following steps:
a display screen for displaying the eye image of the first VR glasses wearer on the outer front side surface of the first VR glasses by the display control method with the imaging distance; thus, let the camera that second VR glasses have can shoot.
Enabling a camera of a second VR glasses to acquire an image of a real environment of a display screen containing the outer front side surface of the first VR glasses, so as to acquire eye information of a wearer of the first VR glasses, and displaying the image of the real environment of the display screen containing the outer front side surface of the first VR glasses to the wearer of the second VR glasses;
a display screen for displaying the eye image of the second VR glasses wearer on the outer front side surface of the second VR glasses by the second VR glasses through the display control method with the imaging distance; thus, the camera that lets first VR glasses have can be shot. The gaze information includes a line of sight.
Enabling a camera of a first VR glasses to acquire an image of a real environment of a display screen containing the outer front side surface of a second VR glasses, so as to acquire eye information of a wearer of the second VR glasses, and displaying the image of the real environment of the display screen containing the outer front side surface of the second VR glasses to the wearer of the first VR glasses;
the first VR glasses prompt for the first VR glasses wearer to perform a prompting action on the display screen of the exterior frontside surface of the second VR glasses that maintains the gaze point in the viewed image of the real environment, the second VR glasses prompt for the second VR glasses wearer to perform a prompting action on the display screen of the exterior frontside surface of the first VR glasses that maintains the gaze point in the viewed image of the real environment; when the first VR glasses wearer and the second VR glasses wearer respectively confirm that the prompting actions prompted by the first VR glasses and the second VR glasses are completed, the first VR glasses wearer and the second VR glasses wearer represent the two pairs of eyes (for example, a voice command for confirming that the prompting actions are completed is input through voice), a first virtual character corresponding to the first VR glasses wearer and a second virtual character corresponding to the second VR glasses wearer are created in a virtual scene, the sight lines of the eyes of the first virtual character and the second virtual character are respectively controlled according to the eye spirit information of the first VR glasses wearer and the eye spirit information of the second VR glasses wearer, and therefore the sight line parallelism between the first VR glasses wearer and the first virtual character and the sight line parallelism between the second VR glasses wearer and the second virtual character are achieved, and the sight lines are shown in fig. 1; and then under the condition that the angle of the visual lines is unchanged, moving the spatial positions of the first virtual character and the second virtual character in the virtual scene to enable the visual lines of the eyes of the first virtual character and the second virtual character to be overlapped, wherein the angle of the visual lines is not changed, and the position of the first virtual character and the position of the second virtual character are not changed, and the position of the first virtual character and the position of the second virtual. In this way, the relative spatial positional relationship between the first virtual character and the second virtual character can be adjusted to be in agreement with the relative spatial positional relationship between the first VR glasses (wearer) and the second VR glasses (wearer).
Preferably, after the line of sight of the eyes of the first virtual character and the second virtual character is overlapped, the relative spatial positions of the first virtual character and the second virtual character in the virtual scene are fixed, and the eye spirit of the first virtual character and the eye spirit of the second virtual character are synchronously adjusted according to the eye images of the first VR glasses wearer and the second VR glasses wearer respectively.
The orientation of the camera of the shooting external reality environment of VR glasses such as first VR glasses, second VR glasses is coaxial or parallel with VR glasses. Those skilled in the art can refer to a camera implementation on the back of the handset. The camera shoots a real-time picture, for example, a front camera or a rear camera arranged on a smart phone is utilized when a WeChat video chat is carried out. The orientation of the camera that VR glasses have sets up with the dead ahead coaxial arrangement of VR glasses or parallel arrangement. The angle of view in front of the VR glasses depends on the viewing angle of the camera, and for example, if the lens of the camera is a wide-angle lens, the angle of view in front of the VR glasses is larger than that of a standard lens. Therefore, although the VR glasses wearer cannot directly observe the real environment through the glasses, the VR glasses are the image of the real environment acquired by the real-time real camera to the wearer, so that the wearer can indirectly observe the real-time real environment in front, the visual effect is similar to that of the AR glasses, and the visual observation effect of the real-time real image is the same as or basically the same as that of the real scene.
According to the present invention, there is provided a display control system having an imaging distance, comprising:
a wearer eye image acquisition module: acquiring an eye image of a VR glasses wearer by using a camera on the inner side of the VR glasses; in the prior art, VR glasses can learn the point of regard of the wearer according to the eye image of gathering, can refer to in view of the above and realize this module.
The spatial position adjusting module: according to the depth information in the eye image, acquiring the distance between a camera on the inner side of the VR glasses and the eyes of a VR glasses wearer; obtaining the distance relation between the eyes of a VR glasses wearer and the display screen on the outer front side surface of the VR glasses according to the known distance relation between the display screen on the outer front side surface of the VR glasses and the cameras on the inner sides of the VR glasses;
a depth image generation module: and obtaining the imaging distance of the eyes of the VR glasses wearer relative to the surface of the display screen according to the distance relationship between the eyes of the VR glasses wearer and the display screen on the outer front side surface of the VR glasses. The wearer eye image display module: and displaying real-time eye images of VR glasses wearers obtained by using cameras on the inner sides of the VR glasses in real time according to the imaging distance on a display screen on the outer front side surface of the VR glasses. Specifically, the back of the display screen is connected to the front surface of the outer portion of the VR glasses, so that the display screen is located at the position right in front of the eyes of the wearer, the orientation of the front of the display screen is coaxial or parallel to the orientation of the VR glasses, and the front of the display screen can be seen by people outside the VR glasses due to the fact that the front of the display screen is not shielded, for example, people who do not wear the VR glasses or guardians of children who wear the VR glasses, and then the eyes of the VR glasses wearer are indirectly seen.
Preferably, in the wearer eye image display module, the real-time eye image of the VR glasses wearer acquired by the wearer eye image acquisition module is displayed on a display screen on the front side surface of the outside of the VR glasses after being subjected to left-right mirror image turning processing. In this way, the left and right eyes in the eye image are distributed in accordance with the left and right eyes of the wearer.
According to the present invention, there is provided a control system for a plurality of virtual characters, comprising:
a display screen for enabling the first VR glasses to display an eye image of a wearer of the first VR glasses on an outer front side surface of the first VR glasses through the display control system with the imaging distance; thus, let the camera that second VR glasses have can shoot.
Enabling a camera of a second VR glasses to acquire an image of a real environment of a display screen containing the outer front side surface of the first VR glasses, so as to acquire eye information of a wearer of the first VR glasses, and displaying the image of the real environment of the display screen containing the outer front side surface of the first VR glasses to the wearer of the second VR glasses;
a display screen for enabling the second VR glasses to display the eye image of the wearer of the second VR glasses on the outer front side surface of the second VR glasses through the display control system with the imaging distance; thus, the camera that lets first VR glasses have can be shot. The gaze information includes a line of sight.
Enabling a camera of a first VR glasses to acquire an image of a real environment of a display screen containing the outer front side surface of a second VR glasses, so as to acquire eye information of a wearer of the second VR glasses, and displaying the image of the real environment of the display screen containing the outer front side surface of the second VR glasses to the wearer of the first VR glasses;
the first VR glasses prompt for the first VR glasses wearer to perform a prompting action on the display screen of the exterior frontside surface of the second VR glasses that maintains the gaze point in the viewed image of the real environment, the second VR glasses prompt for the second VR glasses wearer to perform a prompting action on the display screen of the exterior frontside surface of the first VR glasses that maintains the gaze point in the viewed image of the real environment; when the first VR glasses wearer and the second VR glasses wearer respectively confirm that the prompting actions prompted by the first VR glasses and the second VR glasses are completed, the first VR glasses wearer and the second VR glasses wearer represent the two pairs of eyes (for example, a voice command for confirming that the prompting actions are completed is input through voice), a first virtual character corresponding to the first VR glasses wearer and a second virtual character corresponding to the second VR glasses wearer are created in a virtual scene, the sight lines of the eyes of the first virtual character and the second virtual character are respectively controlled according to the eye spirit information of the first VR glasses wearer and the eye spirit information of the second VR glasses wearer, and therefore the sight line parallelism between the first VR glasses wearer and the first virtual character and the sight line parallelism between the second VR glasses wearer and the second virtual character are achieved, and the sight lines are shown in fig. 1; and then under the condition that the angle of the visual lines is unchanged, moving the spatial positions of the first virtual character and the second virtual character in the virtual scene to enable the visual lines of the eyes of the first virtual character and the second virtual character to be overlapped, wherein the angle of the visual lines is not changed, and the position of the first virtual character and the position of the second virtual character are not changed, and the position of the first virtual character and the position of the second virtual. In this way, the relative spatial positional relationship between the first virtual character and the second virtual character can be adjusted to be in agreement with the relative spatial positional relationship between the first VR glasses (wearer) and the second VR glasses (wearer).
Preferably, after the line of sight of the eyes of the first virtual character and the second virtual character is overlapped, the relative spatial positions of the first virtual character and the second virtual character in the virtual scene are fixed, and the eye spirit of the first virtual character and the eye spirit of the second virtual character are synchronously adjusted according to the eye images of the first VR glasses wearer and the second VR glasses wearer respectively.
According to the present invention, there is provided a computer-readable storage medium storing a computer program which, when executed by a processor, implements the steps of the display control method with imaging distance or the steps of the control method of a plurality of virtual persons.
According to the invention, the VR device comprises the computer readable storage medium storing the computer program, or comprises the display control system with the imaging distance, or comprises the control systems of the virtual characters.
The foregoing description of specific embodiments of the present invention has been presented. It is to be understood that the present invention is not limited to the specific embodiments described above, and that various changes or modifications may be made by one skilled in the art within the scope of the appended claims without departing from the spirit of the invention. The embodiments and features of the embodiments of the present application may be combined with each other arbitrarily without conflict.
Claims (10)
1. A display control method with an imaging distance, comprising:
a step of acquiring an eye image of a wearer: acquiring an eye image of a VR glasses wearer by using a camera on the inner side of the VR glasses;
adjusting the spatial position: according to the depth information in the eye image, acquiring the distance between a camera on the inner side of the VR glasses and the eyes of a VR glasses wearer; obtaining the distance relation between the eyes of a VR glasses wearer and the display screen on the outer front side surface of the VR glasses according to the known distance relation between the display screen on the outer front side surface of the VR glasses and the cameras on the inner sides of the VR glasses;
a depth image generation step: obtaining the imaging distance of the eyes of the VR glasses wearer relative to the surface of the display screen according to the distance relationship between the eyes of the VR glasses wearer and the display screen on the outer front side surface of the VR glasses; the wearer eye image display step: and displaying real-time eye images of VR glasses wearers obtained by using cameras on the inner sides of the VR glasses in real time according to the imaging distance on a display screen on the outer front side surface of the VR glasses.
2. The display control method with imaging distance according to claim 1, wherein in the wearer eye image display step, the real-time eye image of the VR glasses wearer acquired in the wearer eye image acquisition step is displayed on a display screen on the external front side surface of VR glasses after being subjected to left-right mirror image flipping processing.
3. A method for controlling a plurality of virtual characters, comprising:
causing a first VR glasses to display an eye image of a wearer of the first VR glasses on a display screen of an outer front side surface of the first VR glasses by the display control method with imaging distance of claim 1;
enabling a camera of a second VR glasses to acquire an image of a real environment of a display screen containing the outer front side surface of the first VR glasses, so as to acquire eye information of a wearer of the first VR glasses, and displaying the image of the real environment of the display screen containing the outer front side surface of the first VR glasses to the wearer of the second VR glasses;
causing a second VR glasses to display an eye image of a wearer of the second VR glasses on a display screen of an outer front side surface of the second VR glasses by the display control method with imaging distance of claim 1;
enabling a camera of a first VR glasses to acquire an image of a real environment of a display screen containing the outer front side surface of a second VR glasses, so as to acquire eye information of a wearer of the second VR glasses, and displaying the image of the real environment of the display screen containing the outer front side surface of the second VR glasses to the wearer of the first VR glasses;
the first VR glasses prompt for the first VR glasses wearer to perform a prompting action on the display screen of the exterior frontside surface of the second VR glasses that maintains the gaze point in the viewed image of the real environment, the second VR glasses prompt for the second VR glasses wearer to perform a prompting action on the display screen of the exterior frontside surface of the first VR glasses that maintains the gaze point in the viewed image of the real environment; when a first VR glasses wearer and a second VR glasses wearer respectively confirm that prompt actions of first VR glasses and second VR glasses are finished, a first virtual character corresponding to the first VR glasses wearer and a second virtual character corresponding to the second VR glasses wearer are created in a virtual scene, visual lines of eyes of the first virtual character and the second virtual character are respectively controlled according to eye spirit information of the first VR glasses wearer and the second VR glasses wearer, and then under the condition that the visual lines are not changed, the spatial positions of the first virtual character and the second virtual character in the virtual scene are moved, so that the visual lines of the eyes of the first virtual character and the second virtual character are overlapped.
4. The method according to claim 3, wherein after the overlapping of the visual lines of the eyes of the first virtual character and the second virtual character, the relative spatial positions of the first virtual character and the second virtual character in the virtual scene are fixed, and the eye spirit of the first virtual character and the eye spirit of the second virtual character are synchronously adjusted according to the eye images of the first VR glasses wearer and the second VR glasses wearer.
5. A display control system having an imaging distance, comprising:
a wearer eye image acquisition module: acquiring an eye image of a VR glasses wearer by using a camera on the inner side of the VR glasses;
adjusting the spatial position: according to the depth information in the eye image, acquiring the distance between a camera on the inner side of the VR glasses and the eyes of a VR glasses wearer; obtaining the distance relation between the eyes of a VR glasses wearer and the display screen on the outer front side surface of the VR glasses according to the known distance relation between the display screen on the outer front side surface of the VR glasses and the cameras on the inner sides of the VR glasses;
a depth image generation step: obtaining the imaging distance of the eyes of the VR glasses wearer relative to the surface of the display screen according to the distance relationship between the eyes of the VR glasses wearer and the display screen on the outer front side surface of the VR glasses; the wearer eye image display module: and displaying real-time eye images of VR glasses wearers obtained by using cameras on the inner sides of the VR glasses in real time according to the imaging distance on a display screen on the outer front side surface of the VR glasses.
6. The display control system with imaging distance as claimed in claim 5, wherein in the wearer eye image display module, the real-time eye image of the VR glasses wearer obtained by the wearer eye image obtaining module is displayed on the display screen on the external front side surface of the VR glasses after being processed by left and right mirror image turning.
7. A control system for a plurality of virtual characters, characterized in that:
displaying an image of an eye of a wearer of the first VR glasses on a display screen of an outer front side surface of the first VR glasses with the first VR glasses passing through the display control system with imaging distance of claim 5;
enabling a camera of a second VR glasses to acquire an image of a real environment of a display screen containing the outer front side surface of the first VR glasses, so as to acquire eye information of a wearer of the first VR glasses, and displaying the image of the real environment of the display screen containing the outer front side surface of the first VR glasses to the wearer of the second VR glasses;
a display screen for causing a second VR glasses to display an image of the eyes of a wearer of the second VR glasses on an exterior front side surface of the second VR glasses via the display control system with imaging distance of claim 5;
enabling a camera of a first VR glasses to acquire an image of a real environment of a display screen containing the outer front side surface of a second VR glasses, so as to acquire eye information of a wearer of the second VR glasses, and displaying the image of the real environment of the display screen containing the outer front side surface of the second VR glasses to the wearer of the first VR glasses;
the first VR glasses prompt for the first VR glasses wearer to perform a prompting action on the display screen of the exterior frontside surface of the second VR glasses that maintains the gaze point in the viewed image of the real environment, the second VR glasses prompt for the second VR glasses wearer to perform a prompting action on the display screen of the exterior frontside surface of the first VR glasses that maintains the gaze point in the viewed image of the real environment; when a first VR glasses wearer and a second VR glasses wearer respectively confirm that prompt actions of first VR glasses and second VR glasses are finished, a first virtual character corresponding to the first VR glasses wearer and a second virtual character corresponding to the second VR glasses wearer are created in a virtual scene, visual lines of eyes of the first virtual character and the second virtual character are respectively controlled according to eye spirit information of the first VR glasses wearer and the second VR glasses wearer, and then under the condition that the visual lines are not changed, the spatial positions of the first virtual character and the second virtual character in the virtual scene are moved, so that the visual lines of the eyes of the first virtual character and the second virtual character are overlapped.
8. The system of claim 7, wherein after the overlapping of the visual lines of the eyes of the first and second virtual persons, the relative spatial positions of the first and second virtual persons in the virtual scene are fixed, and the eye sights of the first and second virtual persons are synchronously adjusted according to the eye images of the first and second VR glasses wearers.
9. A computer-readable storage medium storing a computer program, wherein the computer program when executed by a processor implements the steps of the display control method with imaging distance of any one of claims 1 to 2 or the steps of the control method of a plurality of virtual characters of any one of claims 3 to 4.
10. A VR device comprising a computer readable storage medium storing a computer program of claim 9, or comprising a display control system with imaging distance of any one of claims 5 to 6, or comprising a control system of a plurality of virtual persons of any one of claims 7 to 8.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011453419.4A CN112558906A (en) | 2020-12-11 | 2020-12-11 | Display control method and system with imaging distance, storage medium and VR equipment thereof |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011453419.4A CN112558906A (en) | 2020-12-11 | 2020-12-11 | Display control method and system with imaging distance, storage medium and VR equipment thereof |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112558906A true CN112558906A (en) | 2021-03-26 |
Family
ID=75061603
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011453419.4A Pending CN112558906A (en) | 2020-12-11 | 2020-12-11 | Display control method and system with imaging distance, storage medium and VR equipment thereof |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112558906A (en) |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2005192925A (en) * | 2004-01-09 | 2005-07-21 | Toshihiko Oba | Balance function diagnostic system and method for treating dizziness using the same |
| DE102013210588A1 (en) * | 2013-06-07 | 2014-12-11 | Bayerische Motoren Werke Aktiengesellschaft | Display system with data glasses |
| CN205246972U (en) * | 2015-12-18 | 2016-05-18 | 北京蚁视科技有限公司 | Nearly eye display device of wear -type with eyeball synchronization display function |
| CN106170083A (en) * | 2015-05-18 | 2016-11-30 | 三星电子株式会社 | Image procossing for head mounted display equipment |
| CN107203263A (en) * | 2017-04-11 | 2017-09-26 | 北京峰云视觉技术有限公司 | A kind of virtual reality glasses system and image processing method |
| US20180101227A1 (en) * | 2016-10-06 | 2018-04-12 | Google Inc. | Headset removal in virtual, augmented, and mixed reality using an eye gaze database |
| WO2018203951A1 (en) * | 2017-05-01 | 2018-11-08 | Google Llc | Classifying facial expressions using eye-tracking cameras |
| CN110141422A (en) * | 2019-05-10 | 2019-08-20 | 东华大学 | A kind of blind person's social intelligence glasses |
| CN111385514A (en) * | 2020-02-18 | 2020-07-07 | 华为技术有限公司 | Portrait processing method and device and terminal |
-
2020
- 2020-12-11 CN CN202011453419.4A patent/CN112558906A/en active Pending
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2005192925A (en) * | 2004-01-09 | 2005-07-21 | Toshihiko Oba | Balance function diagnostic system and method for treating dizziness using the same |
| DE102013210588A1 (en) * | 2013-06-07 | 2014-12-11 | Bayerische Motoren Werke Aktiengesellschaft | Display system with data glasses |
| CN106170083A (en) * | 2015-05-18 | 2016-11-30 | 三星电子株式会社 | Image procossing for head mounted display equipment |
| CN205246972U (en) * | 2015-12-18 | 2016-05-18 | 北京蚁视科技有限公司 | Nearly eye display device of wear -type with eyeball synchronization display function |
| US20180101227A1 (en) * | 2016-10-06 | 2018-04-12 | Google Inc. | Headset removal in virtual, augmented, and mixed reality using an eye gaze database |
| CN107203263A (en) * | 2017-04-11 | 2017-09-26 | 北京峰云视觉技术有限公司 | A kind of virtual reality glasses system and image processing method |
| WO2018203951A1 (en) * | 2017-05-01 | 2018-11-08 | Google Llc | Classifying facial expressions using eye-tracking cameras |
| CN110141422A (en) * | 2019-05-10 | 2019-08-20 | 东华大学 | A kind of blind person's social intelligence glasses |
| CN111385514A (en) * | 2020-02-18 | 2020-07-07 | 华为技术有限公司 | Portrait processing method and device and terminal |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106791784B (en) | A kind of the augmented reality display methods and device of actual situation coincidence | |
| US11455032B2 (en) | Immersive displays | |
| CN105739093B (en) | Through mode augmented reality near-to-eye | |
| US10715791B2 (en) | Virtual eyeglass set for viewing actual scene that corrects for different location of lenses than eyes | |
| DE202017105894U1 (en) | Headset removal in virtual, augmented and mixed reality using a look database | |
| CN106484116B (en) | The treating method and apparatus of media file | |
| US11962746B2 (en) | Wide-angle stereoscopic vision with cameras having different parameters | |
| KR20190112712A (en) | Improved method and system for video conferencing with head mounted display (HMD) | |
| CN106168855B (en) | Portable MR glasses, mobile phone and MR glasses system | |
| WO2021110038A1 (en) | 3d display apparatus and 3d image display method | |
| CN109901290B (en) | Method and device for determining gazing area and wearable device | |
| EP3779892A1 (en) | Light-field image generation system, image display system, shape information acquisition server, image generation server, display device, light-field image generation method and image display method | |
| CN108377355A (en) | A kind of video data handling procedure, device and equipment | |
| CN105959667A (en) | Three-dimensional image collection device and system | |
| US20190306457A1 (en) | Video communication device and method for video communication | |
| CN109255838B (en) | Method and device for avoiding double image watching of augmented reality display device | |
| CN114371779A (en) | Visual enhancement method for sight depth guidance | |
| US20210014475A1 (en) | System and method for corrected video-see-through for head mounted displays | |
| CN104216126A (en) | Zooming 3D (third-dimensional) display technique | |
| US20190349561A1 (en) | Multi-camera scene representation including stereo video for vr display | |
| CN112558906A (en) | Display control method and system with imaging distance, storage medium and VR equipment thereof | |
| CN112558769A (en) | External front side display screen control method and control method of multiple virtual characters | |
| JPH02291787A (en) | Wide visual field display device and wide visual field photography device | |
| CN112558770A (en) | Gazed control method and system, storage medium and VR device thereof | |
| CN107222689B (en) | Real scene switching method and device based on VR (virtual reality) lens |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |