JP2023078342A - Virtual reality system and method - Google Patents

Abstract

To provide a computer apparatus and processes for creating Virtual Reality (VR) interactions between two or more users in which at least one user is wearing a VR headset.SOLUTION: A VR imaging computer apparatus is communicably coupled to each of a VR headset device and a camera device. The VR imaging computer creates a 2D image of a user wearing the VR headset provided with sensors using the camera device. A user's pupil movement is tracked using the sensors, and a headset image is removed from the created 2D image of the user wearing the headset. The detected and recorded pupil image of the user rendered by the sensors of the VR headset is then stitched so as to be superimposed on a region in which the headset image is removed from the created 2D image of the user in such a way that another user can view the VR image of the user as if the user is not wearing the headset.SELECTED DRAWING: Figure 6

Description

The present disclosure relates generally to methods and apparatus for capturing and processing two-dimensional (2D) and three-dimensional (3D) images.

(Cross reference to related applications)
This application claims priority from US Patent Application No. 62/642,488, filed March 13, 2019, which is hereby incorporated by reference in its entirety.

Virtual reality (VR) enables highly immersive experiences, offering new ways of viewing the world and the ability to explore new environments, both real and virtual. However, VR headsets make it difficult to create a complete picture of the people participating in the experience, making it difficult to share these experiences with others compared to physical reality.

Part of this disconnect is mitigated by mixed reality (MR), a relevant medium that shares the virtual context of a VR user in a two-dimensional video format, allowing other viewers to perceive the user's virtual experience. . MR makes sharing easier, but headsets continue to block facial expressions and line of sight, creating a major obstacle to a fully engaging human experience and full vision in VR.

Objects and advantages of the exemplary embodiments described below will be set forth in and will become apparent in the following detailed description. Additional advantages of the illustrative embodiments will be realized and attained by the apparatus, systems and methods particularly pointed out in the written description and claims hereof as well as the accompanying drawings.

The general purpose of this research is to provide a live VR chat experience. Currently, VR chat applications utilize animated avatars. The object of the present invention is to replace the avatar with live video without an image of the user's headset visually replaced by a 3D model of the user's head (e.g. previously recorded without the user wearing the headset). That is. Another object of the invention is for each user to adjust his or her level of realism (eg from avatars to live 3D video images).

The accompanying appendices and/or drawings illustrate various non-limiting, illustrative aspects of the invention according to this disclosure.

1 illustrates example computing and mobile devices that can be used to implement the techniques described herein. It shows a user wearing a headset and the view that the user wearing the headset perceives the user wearing the other headset. Fig. 3 shows the process of removing the headset image from the user to create the user's VR as if the headset had been removed. 4 shows part of the process for creating a VR chat between users in the embodiment described below. 4 shows part of the process for creating a VR chat between users in the embodiment described below. 4 shows part of the process for creating a VR chat between users in the embodiment described below. 4 shows part of the process for creating a VR chat between users in the embodiment described below.

The described embodiments are described more fully with reference to the accompanying drawings, in which like reference numerals identify like structural/functional features. The exemplary embodiments described below are merely exemplary and are by no means limited to the exemplary embodiments, as they can be embodied in various forms, as will be appreciated by those skilled in the art. Therefore, the structural and functional details disclosed herein are not to be construed as limiting, but merely as a basis for the claims and to teach those skilled in the art to use the discussed embodiments in various ways. should be interpreted as an expression for Moreover, the terms and phrases used herein are not intended to be limiting, but to provide an enabling description of the illustrated embodiments.

When a range of values is stated, the upper and lower limits of the range and the stated range are encompassed in the illustrated embodiment, unless the context clearly dictates otherwise. The upper and lower limits of these smaller ranges may independently be included in the smaller ranges and are encompassed in the illustrated embodiments, subject to any specifically excluded limit in the stated range. . Where the stated range includes one or both of the limits, ranges excluding either of those included limits are also included in the illustrated embodiment.

Unless defined otherwise, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs. Although any methods and materials similar or equivalent to those described herein can also be used in the practice or testing of the illustrated embodiments, exemplary methods and materials are described here. All publications mentioned herein are incorporated herein by reference to disclose and describe the methods and/or materials in connection with which the publications are cited.

As used in this specification and the appended claims, the singular forms "a," "an," and "the" include plural referents unless the context clearly dictates otherwise. Please note. Thus, for example, reference to "a stimulus" includes a plurality of such stimuli, reference to "a signal" includes reference to one or more signals and equivalents thereof known to those skilled in the art, etc. include.

The publications discussed herein are provided solely for their disclosure prior to the filing date of the present application. Nothing in this specification is to be construed as an admission that the illustrated embodiments are not entitled to antedate such publication by virtue of prior invention. Further, the dates of publication provided may be different from the actual publication dates which may need to be independently confirmed.

It is understood that the exemplary embodiments described below are preferably software algorithms, programs or code stored on a computer readable medium having control logic to enable execution on a machine having a computer processor. should. The apparatus typically includes a storage device configured to provide output from execution of a computer algorithm or program.

As used herein, the term "software" shall be used regardless of whether the implementation is hardware, firmware, software computer products available on disk, memory storage devices, or for download from a remote device. Means synonymous with the code or program that resides in the processor of a computer. Embodiments described herein include such software to implement the equations, relationships, and algorithms described above. Those skilled in the art will appreciate further features and advantages of the illustrated embodiments based on the embodiments described above. Accordingly, the illustrated embodiments are not to be limited by what has been particularly shown and described, except as indicated by the appended claims. All publications and references cited herein are expressly incorporated herein by reference in their entirety.

Reference will now be made illustratively to the drawings, in which like reference characters indicate like elements throughout the several views. FIG. 1 illustrates an exemplary general purpose computing system 600 and general purpose mobile computing device 650 that can be used with the techniques described herein. Computing system 600 and mobile device 650 are to be understood as exemplary embodiments of which one or more components may be used with the illustrated embodiments of the invention described herein. be.

Computing device 600 includes a processor 602 , memory 604 , storage device 606 , high speed interface 608 connecting to memory 604 and high speed expansion port 610 , and low speed interface 612 connecting to low speed bus 614 and storage device 606 . Each of the members 602, 604, 606, 608, 610, and 612 are interconnected using various buses and may be attached to a common motherboard or otherwise, if desired. Processor 602 processes instructions for execution within computing device 600 , including instructions stored in memory 604 or storage device 606 , to present a GUI on an external input/output device such as display 616 coupled to high speed interface 608 . of graphic information can be displayed. In other implementations, multiple processors and/or multiple buses may be used, as appropriate, along with multiple memories and memory types. Additionally, multiple computing devices 600 may be connected such that each device provides a portion of the required operations (eg, as a server bank, group of blade servers, or multiprocessor system).

Memory 604 stores information within computing device 600 . In one implementation, memory 604 is a volatile memory unit or units. In other implementations, memory 604 is one or more non-volatile memory units. Memory 604 may be other forms of computer-readable media, such as magnetic or optical disks.

Storage device 606 enables computing device 600 to provide mass storage. In one implementation, storage device 606 is a computer-readable medium such as a floppy disk drive, hard disk drive, optical disk drive, or a tape drive, flash memory or other similar solid state memory device, or in a storage area network. and other configurations of devices. A computer program product can be tangibly embodied in an information carrier. The computer program product may also include instructions that, when executed, perform one or more methods as described above. The information carrier is a computer or machine-readable medium such as memory 604 , storage device 606 , or memory on processor 602 .

High speed controller 608 manages bandwidth-intensive operations of computing device 600, and low speed controller 612 manages lower bandwidth-intensive operations. Such functional assignments are merely exemplary. In one implementation, high speed controller 608 is coupled to memory 604, display 616 (eg, via a graphics processor or accelerator), and high speed expansion port 610, which can accept various expansion cards (not shown). In such an implementation, low speed controller 612 is coupled to storage device 606 and low speed expansion port 614 . Low-speed expansion ports can include various communication ports (e.g., USB, Bluetooth, Ethernet, wireless Ethernet) and one or more inputs/outputs such as keyboards, pointing devices, scanners, etc. A device, or connected to a network device such as a switch or router, for example, via a network adapter.

Computing device 600 may be implemented in a number of different forms, as shown. For example, it may be implemented multiple times as a standard server 620 or in a group of such servers. It may also be implemented as part of the rack server system 624 . Further, it may be implemented on a personal computer such as laptop computer 622 . Alternatively, components from computing device 600 may be combined with other components in a mobile device (each such device may include one or more of computing devices 600, 650, The overall system can consist of multiple computing devices 600, 650 communicating with each other.

Computing device 650 includes, among others, processor 652, memory 664, input/output devices such as display 654, communication interface 666, and transceiver 668. Device 650 may also include storage devices such as microdrives or other devices to provide additional storage. Each of the members 650, 652, 664, 654, 666 and 668 are interconnected using various buses, some of which may be attached to a common motherboard or otherwise attached as desired. may

Processor 652 can execute instructions within computing device 650 , including the instructions stored in memory 664 . A processor may be implemented as a chipset of chips containing separate analog and digital processors. The processor may provide coordination of other components of device 650 , such as control of the user interface, applications executed by device 650 , and wireless communications by device 650 .

Processor 652 may communicate with a user via control interface 658 and display interface 656 coupled to display 654 . Display 654 can be, for example, a TFT LCD (Thin Film Transistor Liquid Crystal Display) or OLED (Organic Light Emitting Diode) or other suitable display device. Display interface 656 may comprise suitable circuitry for driving display 654 to present graphics and other information to a user. Control interface 658 can receive commands from a user and convert them to provide them to processor 652 . Additionally, an external interface 662 may be provided to communicate with processor 652 to enable near field communication of device 650 with other devices. External interface 662 may provide, for example, wired communication in some implementations or wireless communication in other implementations, and multiple interfaces may also be used.

Memory 664 stores information within computing device 650 . The memory 664 may be implemented as a computer readable medium or one or more of multiple volatile memory units or multiple non-volatile memory units. Expansion memory 674 is also provided and may be connected to device 650 via expansion interface 672, which may include, for example, a SIMM (single in-line memory module) card interface. Such expanded memory 674 may provide additional storage space for device 650 or may also store applications or other information for device 650 . Specifically, expansion memory 674 contains instructions that perform or supplement the above steps, and may also contain security information. Thus, for example, expansion memory 674 may be provided as a security module for device 650 and may be programmed with instructions that enable secure use of device 650 . In addition, secure applications may be provided through the SIMM card with additional information, such as placing identification information on the SIMM card in a way that cannot be hacked.

The memory may include, for example, flash memory and/or NVRAM memory, as discussed below. In one embodiment, a computer program product is tangibly embodied in an information carrier. The computer program product contains instructions that, when executed, perform one or more methods as described above. The information carrier is a computer or machine readable medium, such as memory 664 , expansion memory 674 , or memory on processor 652 , and may be received via transceiver 668 or external interface 662 , for example.

Device 650 may communicate wirelessly via communication interface 666, which may optionally include digital signal processing circuitry. Communication interface 666 may provide communication under various modes or protocols such as GSM voice calls, SMS, EMS, or MMS messaging, CDMA, TDMA, PDC, WCDMA, CDMA2000, or GPRS, among others. can be done. Such communication may occur via radio frequency transceiver 668, for example. Additionally, short-range communication is possible, such as by using Bluetooth®, Wi-Fi®, or other such transceivers (not shown). Additionally, a GPS (Global Positioning System) receiver module 670 may provide additional navigation and location-related wireless data to the device 650 that may be appropriately used by applications running on the device 650 .

The device 650 can also audibly communicate using an audio codec 660 that can receive speech information from a user and convert the speech information into usable digital information. Similarly, audio codec 660 may generate audible sounds for the user, such as through a speaker within a handset of device 650 . Such sounds can include sounds from voice calls and can also include recorded sounds (e.g., voice messages, music files, etc.) and sounds generated by applications running on device 650.

Computing device 650 may be implemented in a number of different forms, as shown. For example, computing device 650 may be implemented as mobile phone 680 . Computing device 650 may also be implemented as part of smart phone 682, personal digital assistant, or other similar mobile device.

Various implementations of the systems and techniques described herein may be realized in digital electronic circuits, integrated circuits, specially designed application-specific integrated circuits (ASICs), computer hardware, firmware, software, and/or combinations thereof. can. These various implementations include implementation in one or more computer programs executable and/or interpreted by a programmable system including at least one programmable processor. The processor is combined to input and output data and instructions to the storage system, at least one input device, and at least one output device for a special or general purpose.

These computer programs (also referred to as programs, software, software applications or code) contain machine language instructions for programmable processors and can be written in a high level procedural and/or object oriented programming language and/or assembly/machine language. can be implemented with As used herein, the terms "machine-readable medium" and "computer-readable medium" refer to the transfer of machine instructions and/or data to a programmable processor (including machine-readable media that receive machine instructions as machine-readable signals). Refers to any computer program product, apparatus and/or device (eg, magnetic disk, optical disk, memory, programmable logic device (PLD)) used hereinafter that is used to provide. The term "machine-readable signal" refers to any signal used to provide machine instructions and/or data to a programmable processor.

To provide user interaction, the systems and techniques described herein use display devices (such as CRT (cathode ray tube) and LCD (liquid crystal display) monitors) (and other suitable display technology), a keyboard, and a pointing device (such as a mouse or trackball) that allows a user to provide input to the computer. Other types of devices can also be used to provide user interaction. For example, the feedback provided to the user can be any form of sensory feedback (eg, visual, auditory, or tactile feedback). Also, input from the user can be received in any form, including acoustic, speech, or tactile input.

The systems and techniques described herein can be implemented in computing systems. The computing system may be a back-end component (eg, as a data server), or a middleware component (eg, an application server), or a front-end component (eg, a graphical server that allows users to interact with implementations of the systems and techniques described herein). client computer with a user interface or web browser), or any combination of such back-end, middleware, or front-end components. The components of the system can be interconnected by any form or medium of digital data communication, such as a communication network. Examples of communication networks include local area networks (“LAN”), wide area networks (“WAN”), and the Internet.

The computing system can include clients and servers. A client and server are generally remote from each other and typically interact through a communication network. The relationship of client and server arises by virtue of computer programs running on the respective computers and having a client/server relationship to each other.

The computing device shown in FIG. 1 is interfaced with virtual reality (VR headset 690). In the illustrated embodiment, one or more sensors are included in the VR headset to virtually remove the appearance of headset 690 when one user interacts with another. For example, headset sensors 690 may include one or more LEDs 691 that illuminate the user's eyes while tracking the user's pupils, and one or more microcameras 693 for recording the user's eyes/pupils.

For example, embodiments of the present invention use the camera device 400 to model the user's face 704 without the headset 690 as a proxy for the user's hidden face when the headset 690 is worn. . This proxy is used to synthesize faces in mixed reality (MR) video. This gives the impression that the headset 690 is removed while interacting with other users in the VR realm. For example, this initial calibration step may require the user 704 to sit in front of the color+depth camera 400 and monitor and then track markers on the monitor with their eyes. This calibration procedure takes a 3D face model of user 704 and creates a database that maps appearance images (or textures) (via sensors 691 and 693) to different gaze directions and blinks. The aforementioned gaze database (ie, preferably textured face models indexed by gaze) dynamically changes the appearance of the user's face to produce the desired (and real-time) gaze. This allows for the creation of natural and lifelike synthetic facial appearances. It should be appreciated that the composition of the face can be changed by using suitable wireframe software techniques.

In some implementations, one or more input devices in addition to computing devices (eg, mouse, keyboard) can be rendered in a computer-generated 3D environment. Rendered input devices (rendered mouse, rendered keyboard, etc.) can be used as rendered in the VR space to control objects in the VR space.

Computing device 600 is intended to represent various forms of digital computers, such as laptops, desktops, workstations, personal digital assistants, servers, blade servers, mainframes, and other suitable computers. Computing device 650 is intended to represent various forms of mobile devices such as personal digital assistants, mobile phones, smart phones, and other similar computing devices. The members, their connections and relationships, and their functions shown herein are for illustrative purposes only and are not intended to limit the implementation of the inventions described and/or claimed in this document. not

Thus, an exemplary computing system environment 100 is schematically illustrated and described with reference to FIG. Implementations of various exemplary embodiments are described below with reference to FIGS.

It should be appreciated that the environment of use of the exemplary embodiment of the present invention relates to a system 600 that preferably enables online chat in VR with live video. It should be understood that the examples discussed below used to describe the illustrated embodiments assume a live chat between two users, a local user and a remote user (to which the invention is limited). should not be understood as). An exemplary embodiment includes one or more components of the system 600 described above, including a VR system such as the Oculus Rift™, one or more webcams 400 per user, and preferably a green screen. including. Referring to FIG. 2, during a VR chat session according to the illustrated embodiment, for example, a remote user 700 wearing a headset 690 can see other users 702 (headset 690) minus the headset 690 worn by local user 704. 690) live video can be seen in VR. Similarly, during the same VR chat session, a remote user 702 wearing a headset 690 will see the live video of user 700 (wearing the headset 690) minus the headset 690 worn by the local user in VR. is visible in VR.

According to one aspect of the present invention (and with reference to FIG. 3), the vision of the remote user's headset is replaced by superimposing pre-recorded still images/video of the local user's head. It is preferable to overlap only a portion of the user's head when wearing the VR headset, as the mouth and lower part of the face are typically still visible. Preferably, the live video effect is created with chromakey (“green screen”) technology, preferably using a standard 2D webcam 400 (FIG. 4). Therefore, according to the illustrated embodiment, each user 704, 706 is preferably positioned in front of a portable green screen (402). It should be appreciated that this may be counteracted by certain software techniques, or that a 3D camera may be used to determine the user's outline without a green screen.

As described below, according to an exemplary embodiment, two or more users (704 and 706) can participate in a live online chat using special webcams 400 at each user's location. . Each user (704, 706) preferably wears a VR headset 690 (700, 702) so that each user (704, 706) can superimpose and pre-record the other user's head. Look at the images at (706, 704). The broadcast image is preferably a composite of live video and pre-recorded images. The live video preferably includes the body directly above the user's mouth area (FIG. 3) (eg, where VR headsets 690 typically reside). Therefore, the images recorded are preferably of the user's nose, eyes, and top of the head (704, 706). It should be appreciated that a live chat with three or more people can be realized, such as a corporate video conference.

This recorded image can also be pre-created using a special form of photogrammetry. This is a method of stitching and processing multiple 2D images to create a 3D model and textures. Currently, this process is expensive and time consuming, requiring special hardware and multiple cameras. In contrast, according to embodiments of the present invention, an inexpensive stereoscopic camera consisting of two cameras facing the user, each having either stereoscopic or monoscopic vision, can be utilized. For example, the user rotates in a chair while the camera records and captures the scene. Post-processing of the stereoscopic or monoscopic camera output is used to generate the 3D model.

Exemplary steps for enabling a VR session according to an exemplary embodiment are described with reference to FIGS. First, the face of each user 704 (FIG. 4), 706 (FIG. 5) without a headset is captured by the webcam 400 . Each user (704, 706) then dons a headset 690, as shown in FIGS. Headset 690 includes the aforementioned LED sensors 691 and 693 that detect eye gaze, movement and blinks. Sensor 691 preferably illuminates one of the user's eyes in headset 690 to track the movement of the pupil while micro-video camera sensor 693 tracks the user's pupil. The processing chip 602 is configured to restore the moving pupils to the face, preferably by "stitching" the pupils through software to complete the image of the face obscured by the headset 690. , is preferably operable. Thus, both users 704 and 706 can see in real-time (via their respective headsets 690) as if the other user's 704, 706 face was in front of them and not obscured by the headset 690. ) can see each other's 3D images.

More preferably, by further using electro-sensitive devices placed on each user's forehead and eyebrows, each user's 704, 706 frown expression can also be tracked via software processing on the processing chip 602. .

In summary, according to one or more exemplary embodiments, the present invention enables virtual projection of a user's webcam video stream in a video chat, excluding the user's headset. This is accomplished by modeling the user's head in 3D using modeling techniques such as photogrammetry. For example, the top of the user's head is replaced by this model in real time, so that other participating users see only the participating user's body, head, face, and eyes minus the headset 690 .

One or more stationary stereoscopic 3D cameras (e.g., StereoLabs ZED cameras, Microsoft Kinect, Intel RealSense line of 3D cameras, etc.) are used to surround multiple users (e.g., three or more users) and It should be understood that it may be modeled 3D camera technology may additionally calculate the user's position and provide VR collaborative interaction. For example, two users can play a game of catch on Mars, or two can take a virtual walk through the Grand Canyon together.

It should be appreciated that the computing system 600 and headset 690 of the present invention are configured and operable for use in an augmented reality (AR) setting. AR is understood to be a technique for layering a computer-generated extension on top of an existing reality to make it more meaningful through the ability to manipulate it. The illustrated embodiment is an AR being developed for use as an app and a headset 690 that preferably blends the digital elements into the real world in such a way that the digital elements and the real world are accentuated with each other. including. For example, two or more users, each at different locations, wearing headsets 690 of the present invention may be placed next to each other in a selected setting (e.g., skydiving) and/or location (e.g., Paris). The headset 690 can be used/operated in such a way that the This allows them not only to imagine the same setting in real time (e.g., the streets of Paris, France), but also to see each other as if the headset 690 were removed according to the teachings herein.

Additionally, additional embodiments of computing system 600 and/or headset 690 preferably use at least two separate video feeds and/or a single video feed, preferably in combination with a predetermined still frame image cache. It should be appreciated that it can be configured to provide real-time image stitching. Since the 'eye region' of the user's face is usually obscured by the VR display device, eye tracking is obtained from the initial 'setup' phase (image caching) and used for the image stitching step. Preferably, real-time selection of mixed and/or "blended" images is performed via a camera mounted within the VR display device. This provides real-time 3D face tracking and reconstruction using the final (compositing/stitching) video. It should be appreciated that by using a digitally created face (representing the user) in real time, the face/result is preferably composited with either real-time video and/or depth extraction of the user. It should be appreciated that the user's body is preferably extracted from its background using either green background and/or depth extraction techniques. Further, it should be appreciated that the fully reconstructed user may be composited into numerous applications such as, but not limited to, 360-degree videos, VR chat rooms, and other applicable applications. Additionally, various technologies (e.g., SDKs, APIs, etc.) currently in use and/or under study include, but are not limited to: EmguCV, OpenCV and MATLAB®; ZED camera with SDK; ARKit; major programming languages: C# and C++; Unity (game engine); Oculus and/or Vive (VR display devices).

In the specific exemplary embodiments above, it is understood that the various non-limiting embodiments described herein can be implemented separately or selectively in combination for a particular application. sea bream. Moreover, some of the various features of the non-limiting embodiments described above may be used without other described corresponding features. Accordingly, the description provided herein should be considered merely illustrative of the principles, teachings, and exemplary embodiments of this invention and not limiting thereof. .

Claims (14)

A computational method for generating a virtual reality (VR) interaction between two or more users, at least one user wearing a VR headset, comprising:
generating, using a camera device, a two-dimensional (2D) image of at least one user wearing a VR headset equipped with one or more sensors;
tracking movement of the user's pupil using the one or more sensors;
removing a headset image from the generated 2D image of the user wearing the headset;
Detected and recorded rendering of the user by the one or more sensors so that other users can view the VR image of the user as if the user were not wearing the headset. stitching a pupil image to overlay the region from the generated 2D image of the user where the headset image was removed;
A calculation method that has 2. The computational method of claim 1, wherein the 2D image is generated using a video camera. 2. The computing method according to claim 1, wherein said camera device comprises a depth sensor. 2. The computing method of claim 1, wherein the one or more sensors comprise infrared LED sensors. 5. The computing method of claim 4, wherein the one or more sensors further comprise a micro-video camera for recording the orientation of the user's pupil. 3. The method of claim 1, wherein users can see each other in real time. 1. An apparatus for generating a virtual reality (VR) interaction between two or more users, at least one user wearing a VR headset, comprising:
at least one VR headset device equipped with one or more sensor components;
a camera device for capturing at least an image of a user wearing said VR headset device;
a VR imaging computing device communicatively connected to each of said at least one VR headset device and camera device;
with
The VR imaging computing device comprises:
memory;
a processor in communication with the memory and configured to execute a plurality of instructions stored in the memory;
with
Said instruction
generating, using a camera device, a two-dimensional (2D) image of at least one user wearing a VR headset equipped with one or more sensors;
tracking movement of the user's pupil using the one or more sensors mounted on the VR headset;
removing a headset image from the generated 2D image of the user wearing the headset;
A view of the user rendered by the one or more sensors of the VR headset such that other users can see the VR image of the user as if the user were not wearing the headset. stitching the detected and recorded pupil image to overlay the area where the headset image was removed from the generated 2D image of the user;
An apparatus that causes the processor to: 10. A device for generating virtual reality (VR) interactions between two or more users as recited in claim 9, wherein said camera device is a video camera. 10. A device for generating virtual reality (VR) interactions between two or more users as recited in claim 9, wherein said camera device is integrated with a smart phone device. 2. A device for generating virtual reality (VR) interactions between two or more users as recited in claim 1, wherein said camera device comprises a depth sensor. 2. An apparatus for generating virtual reality (VR) interactions between two or more users as recited in claim 1, wherein said one or more sensor components mounted on said VR headset include infrared LED sensors. 12. The virtual communication between two or more users of claim 11, wherein the one or more sensor components mounted on the VR headset include at least one micro-video camera for recording user pupil orientation. Apparatus for creating real-life (VR) interactions. 8. An apparatus for creating virtual reality (VR) interactions between two or more users as recited in claim 7, wherein the users can see each other in real time. 8. Apparatus for generating virtual reality (VR) interactions between two or more users according to claim 7, wherein the users can see a predetermined image as a background.

Images