CN111562841A - Remote online method, device, equipment and storage medium of virtual reality system - Google Patents
Remote online method, device, equipment and storage medium of virtual reality system Download PDFInfo
- Publication number
- CN111562841A CN111562841A CN202010346433.8A CN202010346433A CN111562841A CN 111562841 A CN111562841 A CN 111562841A CN 202010346433 A CN202010346433 A CN 202010346433A CN 111562841 A CN111562841 A CN 111562841A
- Authority
- CN
- China
- Prior art keywords
- address
- virtual reality
- online
- virtual
- image display
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L12/00—Data switching networks
- H04L12/28—Data switching networks characterised by path configuration, e.g. LAN [Local Area Networks] or WAN [Wide Area Networks]
- H04L12/46—Interconnection of networks
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/12—Protocols specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/14—Systems for two-way working
Landscapes
- Engineering & Computer Science (AREA)
- Signal Processing (AREA)
- Computer Networks & Wireless Communication (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- General Health & Medical Sciences (AREA)
- Computing Systems (AREA)
- Medical Informatics (AREA)
- Health & Medical Sciences (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Multimedia (AREA)
- Information Transfer Between Computers (AREA)
- Computer And Data Communications (AREA)
Abstract
The invention relates to the technical field of virtual reality, and discloses a remote on-line method, a device, equipment and a storage medium of a virtual reality system, which are used for realizing the on-line interaction of the remote virtual reality system. The method comprises the following steps: acquiring an online request for establishing communication connection from a first VR device to a second VR device; reading a first IP address of the first VR device and a second IP address of the second VR device from a preset virtual reality peripheral network library according to the online request; according to the first IP address, the second IP address and a virtual reality peripheral network protocol, establishing a remote online IP address of the first VR device and a remote online IP address of the second VR device; according to the remote online IP address, communication connection from the first VR device to the second VR device is established.
Description
Technical Field
The invention relates to the technical field of virtual reality, in particular to a remote online method, a remote online device, remote online equipment and a storage medium of a virtual reality system.
Background
The internet technology is continuously upgraded, and technical schemes such as VR and AR are generated under the pursuit of continuously updated experience of people. The VR technology is continuously updated and developed, real data are presented in the network in real time and interact with data of the virtual network, and the sensory experience and the image processing technology of people are improved.
In the prior art, multi-user virtual space interaction is realized based on a local area network, wherein the content of the multi-user virtual space interaction comprises training, games and real rehearsal. The realization of the interactive scheme of the multi-person large space based on the local area network can cause region limitation to reduce the application range of VR technology, so that a multi-person virtual space allopatric interactive scheme based on a public network is needed, and inconvenience caused by the region limitation is reduced.
Disclosure of Invention
The invention mainly aims to solve the technical problem of how to realize the remote communication connection based on the VR technology.
The invention provides a remote online method of a virtual reality system in a first aspect, which comprises the following steps:
acquiring an online request for establishing communication connection from a first VR device to a second VR device, wherein the first VR device and the second VR device are remote devices;
reading a first IP address of the first VR device and a second IP address of the second VR device from a preset virtual reality peripheral network library according to the online request, wherein at least one of the first IP address and the second IP address is a public network IP address;
according to the first IP address, the second IP address and a virtual reality peripheral network protocol, establishing a remote online IP address of the first VR device and a remote online IP address of the second VR device;
and establishing communication connection from the first VR device to the second VR device according to the remote online IP address.
Optionally, in a first implementation manner of the first aspect of the present invention, the reading, according to the connection request, the first IP address of the first VR device and the second IP address of the second VR device from a preset virtual reality peripheral network library includes:
inquiring the states of the intranet ports of the first VR equipment and the second VR equipment respectively recorded in the preset virtual reality peripheral network according to the online request, and judging whether the states of the intranet ports are in an open state or not;
if the first intranet port of the first VR device is not in an open state, determining that the first IP address is a first public network IP address and the second IP address is a second intranet IP address, and reading the corresponding IP addresses from a preset virtual reality peripheral network library;
if the first intranet port of the first VR device is in an open state, determining that the first IP address is a first intranet IP address, and reading the state of the second intranet port corresponding to the second IP address;
judging whether the second intranet port is in an open state or not;
and if the second intranet port is not in an open state, confirming that the second IP address is a public network IP address, and reading a corresponding IP address from a preset virtual reality peripheral network library.
Optionally, in a second implementation manner of the first aspect of the present invention, the creating an allopatric online IP address of the first VR device and an allopatric online IP address of the second VR device according to the first IP address, the second IP address, and a virtual reality peripheral network protocol includes:
receiving an IP configuration command, and reading configuration data in the IP configuration command;
generating a remote online IP address from the first public network IP address and the second intranet IP address according to the configuration data and a virtual reality peripheral network protocol; or generating the different-place online IP address from the first public network IP address and the second public network IP address according to the configuration data and the virtual reality peripheral network protocol.
Optionally, in a third implementation manner of the first aspect of the present invention, the first VR device includes a first optical action collector and a first image display, the second VR device includes a second optical action collector and a second image display, and after the establishing of the communication connection from the first VR device to the second VR device according to the remote online IP address, the method further includes:
judging whether the state of the communication connection is a connected state;
if the first image display and the second image display are in a connected state, synchronizing virtual images in the first image display and the second image display through the communication connection;
and if the virtual connection state is not the connected state, updating the first IP address and the second IP address in the preset virtual reality peripheral network library, and reestablishing the communication connection from the first VR equipment to the second VR equipment based on the updated first IP address, the updated second IP address and the virtual reality peripheral network protocol.
Optionally, in a fourth implementation manner of the first aspect of the present invention, the synchronizing the virtual images in the first image display and the second image display through the communication connection includes:
acquiring a first virtual image displayed in the first image display and acquiring a second virtual image displayed in the second image display;
analyzing the first virtual image and the second virtual image, integrating the first virtual image and the second virtual image, and generating a synchronous virtual image;
displaying the synchronized virtual image in the first display and the second display.
Optionally, in a fifth implementation manner of the first aspect of the present invention, the method for remotely connecting to a virtual reality system further includes:
and if the first IP address and the second IP address are not public network IP addresses, displaying the notification information that the remote connection cannot be carried out on the first image display and the second image display.
Optionally, in a sixth implementation manner of the first aspect of the present invention, after the synchronizing the virtual images in the first image display and the second image display through the communication connection, the method further includes:
acquiring operation commands in the first optical action collector and the second optical action collector, and acquiring action three-dimensional coordinate data acquired by the first optical action collector and the second optical action collector;
resolving the action three-dimensional coordinate data according to a preset algorithm to obtain three-dimensional attitude data;
analyzing the operation command to obtain an adjustment instruction for adjusting the three-dimensional attitude data;
generating an updated virtual image according to the adjusting instruction and the three-dimensional attitude data;
displaying the updated virtual image in the first image display and the second image display over the communication connection.
The second aspect of the present invention provides a remote online device of a virtual reality system, including:
an obtaining module, configured to obtain an online request for establishing a communication connection between a first VR device and a second VR device, where the first VR device and the second VR device are remote devices;
a reading module, configured to read, according to the online request, a first IP address of the first VR device and a second IP address of the second VR device from a preset virtual reality peripheral network library, where at least one of the first IP address and the second IP address is a public network IP address;
the construction module is used for creating different-place online IP addresses of the first VR device and the second VR device according to the first IP address, the second IP address and a virtual reality peripheral network protocol;
and the establishing module is used for establishing communication connection from the first VR equipment to the second VR equipment according to the remote online IP address.
Optionally, in a first implementation manner of the second aspect of the present invention, the reading module is specifically configured to:
inquiring the states of the intranet ports of the first VR equipment and the second VR equipment respectively recorded in the preset virtual reality peripheral network according to the online request, and judging whether the states of the intranet ports are in an open state or not;
if the first intranet port of the first VR device is not in an open state, determining that the first IP address is a first public network IP address and the second IP address is a second intranet IP address, and reading the corresponding IP addresses from a preset virtual reality peripheral network library;
if the first intranet port of the first VR device is in an open state, determining that the first IP address is a first intranet IP address, and reading the state of the second intranet port corresponding to the second IP address;
judging whether the second intranet port is in an open state or not;
and if the second intranet port is not in an open state, confirming that the second IP address is a public network IP address, and reading a corresponding IP address from a preset virtual reality peripheral network library.
Optionally, in a second implementation manner of the second aspect of the present invention, the building module is specifically configured to:
receiving an IP configuration command, and reading configuration data in the IP configuration command;
generating a remote online IP address from the first public network IP address and the second intranet IP address according to the configuration data and a virtual reality peripheral network protocol; or generating the different-place online IP address from the first public network IP address and the second public network IP address according to the configuration data and the virtual reality peripheral network protocol.
Optionally, in a third implementation manner of the second aspect of the present invention, the remote online apparatus of the virtual reality system further includes:
the state judgment module is used for judging whether the state of the communication connection is a communication state;
a synchronization module for synchronizing virtual images in the first image display and the second image display through the communication connection if the state of the communication connection is a connected state;
and the reestablishing module is used for updating the first IP address and the second IP address in the preset virtual reality peripheral network library if the communication connection state is a connected state, and reestablishing the communication connection from the first VR device to the second VR device based on the updated first IP address, the updated second IP address and the virtual reality peripheral network protocol.
Optionally, in a fourth implementation manner of the second aspect of the present invention, the synchronization module includes:
an acquisition unit configured to acquire a first virtual image displayed on the first image display and acquire a second virtual image displayed on the second image display;
the generating unit is used for analyzing the first virtual image and the second virtual image, integrating the first virtual image and the second virtual image and generating a synchronous virtual image;
a display unit to display the synchronized virtual image in the first display and the second display.
Optionally, in a fifth implementation manner of the second aspect of the present invention, the remote online apparatus of the virtual reality system further includes:
and the notification module is used for displaying notification information which cannot be remotely connected in the first image display and the second image display if the first IP address and the second IP address are not public network IP addresses.
Optionally, in a sixth implementation manner of the second aspect of the present invention, the remote online apparatus of the virtual reality system further includes:
the acquisition module is used for acquiring operation commands in the first optical action collector and the second optical action collector and acquiring action three-dimensional coordinate data acquired by the first optical action collector and the second optical action collector;
the resolving module is used for resolving the action three-dimensional coordinate data according to a preset algorithm to obtain three-dimensional attitude data;
the analysis module is used for analyzing the operation command to obtain an adjustment instruction for adjusting the three-dimensional attitude data;
the image generation module is used for generating an updated virtual image according to the adjustment instruction and the three-dimensional attitude data;
and the interactive display module is used for displaying the updated virtual image in the first image display and the second image display through the communication connection.
The third aspect of the present invention provides a remote online device of a virtual reality system, comprising: a memory having instructions stored therein and at least one processor, the memory and the at least one processor interconnected by a line; the at least one processor invokes the instructions in the memory to cause the offsite online device of the virtual reality system to perform the offsite online method of the virtual reality system described above.
A fourth aspect of the present invention provides a computer-readable storage medium, which stores instructions that, when executed on a computer, cause the computer to perform the above-mentioned remote online method of the virtual reality system.
In the technical scheme provided by the invention, an online request for establishing communication connection between first VR equipment and second VR equipment is obtained, wherein the first VR equipment and the second VR equipment are remote equipment; reading a first IP address of the first VR device and a second IP address of the second VR device from a preset virtual reality peripheral network library according to the online request, wherein at least one of the first IP address and the second IP address is a public network IP address; according to the first IP address, the second IP address and a virtual reality peripheral network protocol, establishing a remote online IP address of the first VR device and a remote online IP address of the second VR device; and establishing communication connection from the first VR device to the second VR device according to the remote online IP address. In the embodiment of the invention, the communication connection of the different-place VR equipment is established based on the public network by adjusting the transmission protocol, so that the purpose of communication interaction of the different-place VR equipment is realized.
Drawings
FIG. 1 is a diagram of a first embodiment of an offsite online method of a virtual reality system according to an embodiment of the present invention;
FIG. 2 is a diagram of a second embodiment of an offsite online method of a virtual reality system according to an embodiment of the present invention;
FIG. 3 is a diagram of a third embodiment of an offsite online method of a virtual reality system according to an embodiment of the present invention;
FIG. 4 is a diagram illustrating a fourth embodiment of an offsite online method of a virtual reality system according to an embodiment of the present invention;
FIG. 5 is a diagram of a first embodiment of an offsite online device of a virtual reality system according to an embodiment of the present invention;
FIG. 6 is a diagram of a second embodiment of an offsite online device of a virtual reality system according to an embodiment of the present invention;
FIG. 7 is a diagram of a third embodiment of an offsite online device of a virtual reality system according to an embodiment of the present invention;
fig. 8 is a schematic diagram of an embodiment of an offsite online device of a virtual reality system according to an embodiment of the present invention.
Detailed Description
The embodiment of the invention provides a method, a device, equipment and a storage medium for remote connection of a virtual reality system, which are used for acquiring a connection request for establishing communication connection from a first VR equipment to a second VR equipment, wherein the first VR equipment and the second VR equipment are remote equipment; reading a first IP address of the first VR device and a second IP address of the second VR device from a preset virtual reality peripheral network library according to the online request, wherein at least one of the first IP address and the second IP address is a public network IP address; according to the first IP address, the second IP address and a virtual reality peripheral network protocol, establishing a remote online IP address of the first VR device and a remote online IP address of the second VR device; and establishing communication connection from the first VR device to the second VR device according to the remote online IP address. In the embodiment of the invention, the communication connection of the different-place VR equipment is established based on the public network by adjusting the transmission protocol, so that the purpose of communication interaction of the different-place VR equipment is realized.
The terms "first," "second," "third," "fourth," and the like in the description and in the claims, as well as in the drawings, if any, are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It will be appreciated that the data so used may be interchanged under appropriate circumstances such that the embodiments described herein may be practiced otherwise than as specifically illustrated or described herein. Furthermore, the terms "comprises," "comprising," or "having," and any variations thereof, are intended to cover non-exclusive inclusions, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed, but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.
For convenience of understanding, a specific flow of the embodiment of the present invention is described below, and referring to fig. 1, a first embodiment of the remote online method of the virtual reality system in the embodiment of the present invention includes:
101. acquiring an online request for establishing communication connection from a first VR device to a second VR device, wherein the first VR device and the second VR device are remote devices;
in this embodiment, the fact that the first VR device and the second VR device are different devices means that the two devices are not located in the same region, and the region is different mainly in different communication networks, which are different in different local area networks. The online request of the VR device can be sent by any one of the different VR devices, when the first VR device is at the A place and the second VR device is at the B place, the first VR device on the A place sends the online request, the online request is that the VR device can be connected with a computer device, the computer device operates the connection request, or the operator equips the VR device to operate on a preset operation page of the VR device to complete the online request. The VR device has two types, one is an all-in-one machine type, namely the VR device can operate in a virtual page of the VR device by a processor and a communication module. And the other is that only the optical acquisition module and the display have no processor, and the data acquired by the optical acquisition module needs to be processed by the computer equipment and displayed in the VR equipment after the processing is finished.
102. Reading a first IP address of the first VR device and a second IP address of the second VR device from a preset virtual reality peripheral network library according to the online request, wherein at least one of the first IP address and the second IP address is a public network IP address;
in this embodiment, the preset virtual reality peripheral network library includes communication IP addresses of VR devices in a and B, the data in the library is a communication IP address library configured with each other when VR communication systems are established in two places, and the communication IP address library is synchronized to the VR communication devices in the two places, and simultaneously real-time update synchronization can be performed by monitoring changes in IP addresses of the devices in the two places, when the first VR device and the second VR device are online with each other, the VRPN protocol can be adjusted by the communication IP addresses, in practical application, the preset virtual reality peripheral network library can be implemented by using a traditional VRPN protocol, and the traditional VRPN protocol only supports one IP and a port generated randomly, which is not beneficial to connection of a public network, but through modification of the VRPN protocol, the address format in the VRPN protocol is modified, and the combination of the two places IP addresses is implemented, so that the same VRPN server, two ports of a public network and an internal network are exposed, and the public network and the internal network are both networks for transmitting VRPN data. And reading the IP address displayed by the first VR device as X, reading the IP address displayed by the second VR device as Y, and then processing the data of the IP address. The first IP address and the second IP address both correspond to two external ports, and ue4 has an interface: playercotnroe- > islocalcontrolled (); through this interface, the intranet is connected if true is returned and the public network is connected if false is returned.
103. According to the first IP address, the second IP address and a virtual reality peripheral network protocol, establishing a remote online IP address of the first VR device and a remote online IP address of the second VR device;
in this embodiment, the public network IP address and the internal network IP address of the first VR device and the second VR device are stored in the VRPN library, and if both are the internal network IP addresses, the first VR device and the second VR device are not connected, and an IP address connected in a different place is not configured. Only if at least one public network port of the first VR device and the second VR device is open, an online IP address from one public network port to the other device may be configured.
104. And establishing communication connection from the first VR device to the second VR device according to the remote online IP address.
In this embodiment, when the first IP address or the second IP address is a public IP address, at least one of the externally displayed ports of the VRPN protocol supports public network communication, and data transmission between the VR devices in different locations is achieved through the public network communication. When one of the IP addresses is a public network and the other is an internal network, the data is spanned in different places by using the public network firstly through a connection protocol of the public network and the internal network, and then the data is transmitted to the VR equipment through the internal network. And if the first IP address and the second IP address are both public network IP addresses, directly connecting the first VR device with the second VR device by using public network communication. At present, a plurality of computer and mobile phone games are completed based on remote communication, and the communication speed of the VR environment can be guaranteed. The remote on-line equipment of the invention can be a switching equipment composed of a router.
In the embodiment of the invention, the communication connection of the different-place VR equipment is established based on the public network by adjusting the transmission protocol, so that the purpose of communication interaction of the different-place VR equipment is realized.
Referring to fig. 2, a second embodiment of the remote connection method of the virtual reality system according to the embodiment of the present invention includes:
201. acquiring an online request for establishing communication connection from a first VR device to a second VR device, wherein the first VR device and the second VR device are remote devices;
202. inquiring the states of the intranet ports of the first VR equipment and the second VR equipment respectively recorded in the preset virtual reality peripheral network according to the online request;
in this embodiment, the intranet ports of the first VR device and the second VR device recorded in the VRPN library are read, and the intranet ports are in the form of @ X and @ Y, respectively.
203. Judging whether the state of the intranet port is in an open state or not;
in this embodiment, determining the port status uses playercotroe- > islocalcontrolled () to query the intranet port status, and obtaining the function feedback information can obtain the intranet port status.
204. If the first intranet port of the first VR device is not in an open state, determining that the first IP address is a first public network IP address and the second IP address is a second intranet IP address, and reading the corresponding IP addresses from a preset virtual reality peripheral network library;
in this embodiment, if the data returned from the first intranet port X is "Nell" or "closed", the first IP address is determined as the public network IP address, and the corresponding data is queried from the VRPN library for the data of the second IP address and the first IP address.
205. If the first intranet port of the first VR device is in an open state, determining that the first IP address is a first intranet IP address, and reading the state of the second intranet port corresponding to the second IP address;
in this embodiment, if the data returned from the first intranet port X is "open" or "existing", the port status of the second IP address needs to be queried if the first IP address is determined to be the intranet IP address, and the intranet port status is also queried using playercontroe- > islocalcontrolled ().
206. Judging whether the second intranet port is in an open state or not;
in this embodiment, the intranet port status is queried using Playercotnroe- > islocalcontrolled (), and then feedback is obtained to determine whether the intranet port status is open.
207. If the second intranet port is not in an open state, confirming that the second IP address is a public network IP address, and reading a corresponding IP address from a preset virtual reality peripheral network library;
in this embodiment, if the data returned by playercotroe- > islocalcontrolled () is "Nell" or "unopened", etc., the internal network port address of the first IP address is queried from the VRPN library and the public network port of the second IP address is queried.
208. Receiving an IP configuration command, and reading configuration data in the IP configuration command;
in this embodiment, the IP configuration data are X and Y, and the data obtained at this time are displayed on the display for the operator to confirm or the operator to modify. After the configuration command is obtained, the configured data is read.
209. According to the configuration data and a virtual reality peripheral network protocol, generating a remote online IP address by taking the first IP address as a public network IP address and taking the second IP address as an internal network IP address; (ii) a
In the embodiment, according to the IP data X and Y, the remote online IP address is generated according to the adjusted VRPN protocol and the TCP/IP protocol. In another case, the first IP address is an intranet and the second IP address is a public network, which is similar to the case where the first IP address is a public network IP address and the second IP address generates a different-place online IP address for the intranet IP address, which is not repeated again. There is also a case where the first IP address is determined as a public IP address and the second IP address is determined as a public IP address, and then the remote online IP address is generated
210. And establishing communication connection from the first VR device to the second VR device according to the remote online IP address.
In the embodiment of the invention, the communication connection of the different-place VR equipment is established based on the public network by adjusting the transmission protocol, so that the purpose of communication interaction of the different-place VR equipment is realized.
Referring to fig. 3, a third embodiment of the remote online method of the virtual reality system according to the embodiment of the present invention includes:
301. acquiring an online request for establishing communication connection from a first VR device to a second VR device, wherein the first VR device and the second VR device are remote devices;
302. reading a first IP address of the first VR device and a second IP address of the second VR device from a preset virtual reality peripheral network library according to the online request;
303. judging whether at least one public network IP address exists in the first IP address and the second IP address;
304. if the first IP address and the second IP address are not public network IP addresses, displaying notification information that the remote connection cannot be carried out on the first image display and the second image display;
in this embodiment, when it is determined that the first IP address and the second IP address are both intranet IP addresses, a preset notification message "you are good and please check whether the network setting is an extranet public network setting, and currently no long-distance connection is possible" is displayed on the first image display and the second image display, so that the operator can modify the configuration to reestablish the long-distance communication connection.
306. Establishing a communication connection from the first VR device to the second VR device according to the off-line IP address;
305. if so, establishing a remote online IP address of the first VR device and the second VR device according to the first IP address, the second IP address and a virtual reality peripheral network protocol;
306. establishing a communication connection from the first VR device to the second VR device according to the off-line IP address;
307. judging whether the state of the communication connection is a connected state;
in this embodiment, "detection information a" may be sent from the first IP address, recording the sending time: q time "then" detect information a after adding information after the second IP address receives the information, record the time of issuance: q time, record receive time: w time ", then receiving feedback information sent back by the second IP address to judge whether the difference value between the Q time and the W time exceeds a threshold value, if so, indicating that the system is not in a connected state, and if not, indicating that the system is in a connected state.
308. If the first image display and the second image display are in a connected state, synchronizing virtual images in the first image display and the second image display through the communication connection;
in this embodiment, when it is determined that the communication connection is in the connection state, it is necessary to synchronize data of the first VR device and data of the second VR device on the same virtual template, acquire image data from the first VR device and acquire image data from the second VR device, calculate data of each device to present the two device data on the same virtual template, and present the updated virtual image on the first VR device and the second VR device.
309. And if the virtual connection state is not the connected state, updating the first IP address and the second IP address in the preset virtual reality peripheral network library, and reestablishing the communication connection from the first VR equipment to the second VR equipment based on the updated first IP address, the updated second IP address and the virtual reality peripheral network protocol.
In this embodiment, the port settings of the first VR device and the second VR device are re-read, and after determining whether the ports are public network ports, it is determined that the connection can be re-determined using the TCP/IP protocol, so as to ensure stable communication connection.
In the embodiment of the invention, the communication connection of the different-place VR equipment is established based on the public network by adjusting the transmission protocol, so that the purpose of communication interaction of the different-place VR equipment is realized.
Referring to fig. 4, a fourth embodiment of the remote online method of the virtual reality system according to the embodiment of the present invention includes:
401. acquiring an online request for establishing communication connection from a first VR device to a second VR device, wherein the first VR device and the second VR device are remote devices;
402. reading a first IP address of the first VR device and a second IP address of the second VR device from a preset virtual reality peripheral network library according to the online request, wherein at least one of the first IP address and the second IP address is a public network IP address;
403. according to the first IP address, the second IP address and a virtual reality peripheral network protocol, establishing a remote online IP address of the first VR device and a remote online IP address of the second VR device;
404. establishing a communication connection from the first VR device to the second VR device according to the off-line IP address;
405. judging whether the state of the communication connection is a connected state;
406. if not, updating the first IP address and the second IP address in the preset virtual reality peripheral network library, and reestablishing the communication connection from the first VR equipment to the second VR equipment based on the updated first IP address, the second IP address and the virtual reality peripheral network protocol;
407. if yes, acquiring a first virtual image displayed in the first image display, and acquiring a second virtual image displayed in the second image display;
in this embodiment, the first virtual image is read from the first image display using the communication connection, and the second virtual image is obtained at the communication connection also using the TCP/IP protocol.
408. Analyzing the first virtual image and the second virtual image, integrating the first virtual image and the second virtual image, and generating a synchronous virtual image;
in the present embodiment, the image data and the virtual template type of the first virtual image are read, the image data and the virtual template type of the second virtual image are also read, then the image data in the first virtual image and the second virtual image are displayed in the virtual template, and then the generated image data is displayed in the same type of virtual template to generate the synchronized virtual image.
409. Displaying the synchronized virtual image in the first display and the second display;
in this embodiment, the synchronous virtual images are displayed on the first VR device and the second VR device simultaneously, and the number of image display frames can be increased when displaying, so that the images are refreshed at a rate of 120 frames per second, and thus the images seen by the human eyes of the first VR device and the second VR device are substantially the same.
410. Acquiring operation commands in the first optical action collector and the second optical action collector, and acquiring action three-dimensional coordinate data acquired by the first optical action collector and the second optical action collector;
in this embodiment, the action of a person is captured by using an optical collector camera built in the VR device, and three-dimensional coordinate data of the movement of the person is acquired by using a rigid optical sensor attached to the person. The optical acquisition unit is accompanied by an operation command, and the three-dimensional coordinate data of the motion can be adjusted, for example, a rotation command can modify the orientation of the three-dimensional posture data.
411. Resolving the action three-dimensional coordinate data according to a preset algorithm to obtain three-dimensional attitude data;
in this embodiment, in the developed Tenoomi software, the three-dimensional data may be analyzed, the three-dimensional data may be resolved, and the three-dimensional data may be resolved by using an algorithm preset by Tenoomi to obtain three-dimensional attitude data. The three-dimensional pose data includes details of the person's hand orientation, face orientation, hand orientation, body twist angle, and the like.
412. Analyzing the operation command to obtain an adjustment instruction for adjusting the three-dimensional attitude data;
in the present embodiment, the operation command may be a human visual angle rotation adjustment, a control of a firearm in a bolt game, a grasping of an article in a virtual interface, a throwing of an object in a virtual interface, or the like.
413. Generating an updated virtual image according to the adjusting instruction and the three-dimensional attitude data;
in the present embodiment, the virtual image is updated in the virtual interface according to the three-dimensional pose data and the adjustment instruction, and adjustment is performed at a speed of 120 frames, so that a person feels that the items of the virtual interface are changed in real time.
414. Displaying the updated virtual image in the first image display and the second image display over the communication connection.
In this embodiment, the generated updated virtual image is displayed in the VR device, and the network speed measurement may be set to change according to the updated frame number. If the measured network speed is 1M/s, the virtual image in the display is updated by using the update speed of 300 frames/s, and if the measured network speed is 120KB/s, the virtual image is updated by using 60 frames/s, and the update speed can be adjusted at any time.
In the embodiment of the invention, the communication connection of the different-place VR equipment is established based on the public network by adjusting the transmission protocol, so that the purpose of communication interaction of the different-place VR equipment is realized.
In the above description of the remote online method of the virtual reality system in the embodiment of the present invention, referring to fig. 5, a remote online device of the virtual reality system in the embodiment of the present invention is described below, where a first embodiment of the remote online device of the virtual reality system in the embodiment of the present invention includes:
an obtaining module 501, configured to obtain an online request for establishing a communication connection between a first VR device and a second VR device, where the first VR device and the second VR device are remote devices;
a reading module 502, configured to read, according to the online request, a first IP address of the first VR device and a second IP address of the second VR device from a preset virtual reality peripheral network library, where at least one of the first IP address and the second IP address is a public network IP address;
a building module 503, configured to create a remote online IP address of the first VR device and the second VR device according to the first IP address, the second IP address, and the virtual reality peripheral network protocol;
an establishing module 504, configured to establish a communication connection from the first VR device to the second VR device according to the remote online IP address.
In the embodiment of the invention, the communication connection of the different-place VR equipment is established based on the public network by adjusting the transmission protocol, so that the purpose of communication interaction of the different-place VR equipment is realized.
Referring to fig. 6, a second embodiment of the remote online device of the virtual reality system according to the embodiment of the present invention includes:
an obtaining module 601, configured to obtain an online request for establishing a communication connection between a first VR device and a second VR device, where the first VR device and the second VR device are remote devices;
a reading module 602, configured to read, according to the online request, a first IP address of the first VR device and a second IP address of the second VR device from a preset virtual reality peripheral network library, where at least one of the first IP address and the second IP address is a public network IP address;
a building module 603, configured to create an online remote IP address of the first VR device and an online remote IP address of the second VR device according to the first IP address, the second IP address, and a virtual reality peripheral network protocol;
an establishing module 604, configured to establish a communication connection from the first VR device to the second VR device according to the remote online IP address.
Optionally, the reading module 602 is specifically configured to: inquiring the states of the intranet ports of the first VR equipment and the second VR equipment respectively recorded in the preset virtual reality peripheral network according to the online request, and judging whether the states of the intranet ports are in an open state or not; if the first intranet port of the first VR device is not in an open state, determining that the first IP address is a first public network IP address and the second IP address is a second intranet IP address, and reading the corresponding IP addresses from a preset virtual reality peripheral network library; if the first intranet port of the first VR device is in an open state, determining that the first IP address is a public network IP address, and reading the state of the second intranet port corresponding to the second IP address; judging whether the second intranet port is in an open state or not; and if the second intranet port is not in an open state, confirming that the second IP address is a public network IP address, and reading a corresponding IP address from a preset virtual reality peripheral network library.
Optionally, the building module 603 is specifically configured to: receiving an IP configuration command, and reading configuration data in the IP configuration command; generating a remote online IP address from the first public network IP address and the second intranet IP address according to the configuration data and a virtual reality peripheral network protocol; or generating the different-place online IP address from the first public network IP address and the second public network IP address according to the configuration data and the virtual reality peripheral network protocol.
Wherein, the off-site on-line device of the virtual reality system further comprises:
a notification module 605, configured to display notification information that the remote connection cannot be performed on the first image display and the second image display if the first IP address and the second IP address are not public IP addresses
Wherein, the off-site on-line device of the virtual reality system further comprises:
a state judgment module 606, configured to judge whether the state of the communication connection is a connected state;
a synchronization module 607 for synchronizing the virtual images in the first image display and the second image display through the communication connection if the state of the communication connection is a connected state;
a reestablishment module 608, configured to update the first IP address and the second IP address in the preset virtual reality peripheral network library if the state of the communication connection is a connected state, and reestablish the communication connection between the first VR device and the second VR device based on the updated first IP address, the updated second IP address, and the virtual reality peripheral network protocol.
Wherein the synchronization module 607 comprises:
an acquisition unit 6071 configured to acquire a first virtual image displayed on the first image display and acquire a second virtual image displayed on the second image display;
a generating unit 6072 configured to analyze the first virtual image and the second virtual image, integrate the first virtual image and the second virtual image, and generate a synchronized virtual image;
a display unit 6073 for displaying the synchronized virtual image in the first display and the second display.
Wherein, the off-site on-line device of the virtual reality system further comprises:
an acquisition module 609, configured to acquire an operation command in the first optical action collector and the second optical action collector, and acquire action three-dimensional coordinate data acquired by the first optical action collector and the second optical action collector;
the calculating module 610 is used for calculating the action three-dimensional coordinate data according to a preset algorithm to obtain three-dimensional attitude data;
the analyzing module 611 is configured to analyze the operation command to obtain an adjustment instruction for adjusting the three-dimensional posture data;
an image generating module 612, configured to generate an updated virtual image according to the adjustment instruction and the three-dimensional posture data;
an interactive display module 613, configured to display the updated virtual image on the first image display and the second image display through the communication connection.
In the embodiment of the invention, the communication connection of the different-place VR equipment is established based on the public network by adjusting the transmission protocol, so that the purpose of communication interaction of the different-place VR equipment is realized.
In practical application, the remote online apparatus of the virtual reality system may specifically be composed of the following framework structures, as shown in fig. 7, the apparatus includes an RTS hardware system 701, a VRPC hardware system 702, and a route switching device 703 for implementing communication connection between the two local virtual reality systems;
in this embodiment, the VRPC hardware system 702 includes a data processing device 7021, the data processing device 7021 is provided with a tenon system in operation, and the tenon system is whole body motion capture posture analysis software and is configured to process tracker data acquired by the RTS hardware system 701 and construct a corresponding relationship between an actual application scene and a virtual reality scene. The VRPC hardware system 702 further includes a virtual image display 7022, the virtual image display 7022 is used for displaying a virtual reality scene, the virtual image display 7022 can be a display in a wearable VR device, and the virtual image display 7022 can display processing data content on a computer side for a computer display screen.
In this embodiment, the RTS hardware system 701 includes a positioning device (Tracker)7011 and an optical acquisition camera 7012, where the positioning device (Tracker)7011 is an integral device composed of rigid body data collectors attached to the whole body for acquiring body movement postures, each rigid body data collector is rigid body data for acquiring at an attachment point, and each rigid body data collector constitutes a three-dimensional data matrix from mutual relationships. After acquiring the rigid body data, the optical acquisition camera 7012 uploads the rigid body data to a positioning device (Tracker)7011 for spatial positioning, and the Tracker is three-dimensional space position used by target tracking software for tracking whole body motion, so as to obtain 3D coordinate data of a target object. The routing switch 703 includes routing switches 7031 deployed at two different places. When passing through its own public network port, the routing switch 7031 can access the public network port and the intranet port of the routing switch 7031 deployed in a different place. When passing through its own intranet port, the routing switch 7031 can only access the intranet port of the routing switch 7031 deployed in a different place. When the two remote deployment route switches 7031 both use the public network port for communication, the public network cloud can be used for data communication. When the routing switch 7031 is deployed at two different places, one of them uses the public network port and the other uses the intranet port to communicate, the communication can be realized by using the mesh communication gc (grid communication) at one end of the routing switch 7031 using the intranet port.
In the embodiment of the invention, the communication connection of the different-place VR equipment is established based on the public network by adjusting the transmission protocol, so that the purpose of communication interaction of the different-place VR equipment is realized.
Fig. 5, fig. 6, and fig. 7 describe in detail the remote online apparatus of the virtual reality system in the embodiment of the present invention from the perspective of the modular functional entity, and the remote online device of the virtual reality system in the embodiment of the present invention from the perspective of hardware processing is described in detail below.
Fig. 8 is a schematic structural diagram of an offsite online device of a virtual reality system according to an embodiment of the present invention, where the offsite online device 800 of the virtual reality system may have a relatively large difference due to different configurations or performances, and may include one or more processors (CPUs) 810 (e.g., one or more processors) and a memory 820, and one or more storage media 830 (e.g., one or more mass storage devices) storing an application 833 or data 832. Memory 820 and storage medium 830 may be, among other things, transient or persistent storage. The program stored on the storage medium 830 may include one or more modules (not shown), each of which may include a series of instruction operations for the offsite online device 800 of the virtual reality system. Still further, the processor 810 may be configured to communicate with the storage medium 830 to execute a series of instruction operations in the storage medium 830 on the offsite online device 800 of the virtual reality system.
The virtual reality system based offsite online device 800 may also include one or more power supplies 840, one or more wired or wireless network interfaces 850, one or more input-output interfaces 860, and/or one or more operating systems 831, such as Windows server, Mac OSX, Unix, Linux, FreeBSD, etc. Those skilled in the art will appreciate that the offsite online device configuration of the virtual reality system illustrated in fig. 8 does not constitute a limitation of the offsite online device based on the virtual reality system, and may include more or fewer components than illustrated, or some components in combination, or a different arrangement of components.
The invention also provides a computer readable storage medium, which may be a non-volatile computer readable storage medium, or a volatile computer readable storage medium, having stored therein instructions, which when run on a computer, cause the computer to perform the steps of the offsite online method of the virtual reality system.
It is clear to those skilled in the art that, for convenience and brevity of description, the specific working processes of the above-described systems, apparatuses, and units may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again.
The integrated unit, if implemented in the form of a software functional unit and sold or used as a stand-alone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present invention may be embodied in the form of a software product, which is stored in a storage medium and includes instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present invention. And the aforementioned storage medium includes: various media capable of storing program codes, such as a usb disk, a removable hard disk, a read-only memory (ROM), a Random Access Memory (RAM), a magnetic disk, or an optical disk.
The above-mentioned embodiments are only used for illustrating the technical solutions of the present invention, and not for limiting the same; although the present invention has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; and such modifications or substitutions do not depart from the spirit and scope of the corresponding technical solutions of the embodiments of the present invention.
Claims (10)
1. A method for remotely connecting a virtual reality system is characterized by comprising the following steps:
acquiring an online request for establishing communication connection from a first VR device to a second VR device, wherein the first VR device and the second VR device are remote devices;
reading a first IP address of the first VR device and a second IP address of the second VR device from a preset virtual reality peripheral network library according to the online request, wherein at least one of the first IP address and the second IP address is a public network IP address;
according to the first IP address, the second IP address and a virtual reality peripheral network protocol, establishing a remote online IP address of the first VR device and a remote online IP address of the second VR device;
and establishing communication connection from the first VR device to the second VR device according to the remote online IP address.
2. The method of claim 1, wherein reading the first IP address of the first VR device and the second IP address of the second VR device from a pre-configured virtual reality peripheral network library according to the connection request comprises:
inquiring the states of the intranet ports of the first VR equipment and the second VR equipment respectively recorded in the preset virtual reality peripheral network according to the online request, and judging whether the states of the intranet ports are in an open state or not;
if the first intranet port of the first VR device is not in an open state, determining that the first IP address is a first public network IP address and the second IP address is a second intranet IP address, and reading the corresponding IP addresses from a preset virtual reality peripheral network library;
if the first intranet port of the first VR device is in an open state, determining that the first IP address is a first intranet IP address, and reading the state of the second intranet port corresponding to the second IP address;
judging whether the second intranet port is in an open state or not;
and if the second intranet port is not in an open state, confirming that the second IP address is a second public network IP address, and reading a corresponding IP address from a preset virtual reality peripheral network library.
3. The method of claim 2, wherein the creating an offsite online IP address for the first VR device and the second VR device based on the first IP address, the second IP address, and the virtual reality peripheral network protocol comprises:
receiving an IP configuration command, and reading configuration data in the IP configuration command;
generating a remote online IP address from the first public network IP address and the second intranet IP address according to the configuration data and a virtual reality peripheral network protocol; or generating the different-place online IP address from the first public network IP address and the second public network IP address according to the configuration data and the virtual reality peripheral network protocol.
4. The off-line method of the virtual reality system of claim 1, wherein the first VR device comprises a first optical motion collector and a first image display, and the second VR device comprises a second optical motion collector and a second image display, and further comprising, after the establishing the communication connection from the first VR device to the second VR device according to the off-line IP address:
judging whether the state of the communication connection is a connected state;
if the first image display and the second image display are in a connected state, synchronizing virtual images in the first image display and the second image display through the communication connection;
and if the virtual connection state is not the connected state, updating the first IP address and the second IP address in the preset virtual reality peripheral network library, and reestablishing the communication connection from the first VR equipment to the second VR equipment based on the updated first IP address, the updated second IP address and the virtual reality peripheral network protocol.
5. The off-line method of the virtual reality system of claim 4, wherein synchronizing the virtual images on the first image display and the second image display via the communication connection comprises:
acquiring a first virtual image displayed in the first image display and acquiring a second virtual image displayed in the second image display;
analyzing the first virtual image and the second virtual image, integrating the first virtual image and the second virtual image, and generating a synchronous virtual image;
displaying the synchronized virtual image in the first display and the second display.
6. The off-line method of the virtual reality system of claim 4 or 5, further comprising, after the synchronizing the virtual images in the first image display and the second image display via the communication connection:
acquiring operation commands in the first optical action collector and the second optical action collector, and acquiring action three-dimensional coordinate data acquired by the first optical action collector and the second optical action collector;
resolving the action three-dimensional coordinate data according to a preset algorithm to obtain three-dimensional attitude data;
analyzing the operation command to obtain an adjustment instruction for adjusting the three-dimensional attitude data;
generating an updated virtual image according to the adjusting instruction and the three-dimensional attitude data;
displaying the updated virtual image in the first image display and the second image display over the communication connection.
7. The off-site online method of a virtual reality system according to claim 4, further comprising:
and if the first IP address and the second IP address are not public network IP addresses, displaying the notification information that the remote connection cannot be carried out on the first image display and the second image display.
8. An off-site on-line device of a virtual reality system, comprising:
an obtaining module, configured to obtain an online request for establishing a communication connection between a first VR device and a second VR device, where the first VR device and the second VR device are remote devices;
a reading module, configured to read, according to the online request, a first IP address of the first VR device and a second IP address of the second VR device from a preset virtual reality peripheral network library, where at least one of the first IP address and the second IP address is a public network IP address;
the construction module is used for creating different-place online IP addresses of the first VR device and the second VR device according to the first IP address, the second IP address and a virtual reality peripheral network protocol;
and the establishing module is used for establishing communication connection from the first VR equipment to the second VR equipment according to the remote online IP address.
9. An off-site on-line device of a virtual reality system, the off-site on-line device of the virtual reality system comprising: a memory having instructions stored therein and at least one processor, the memory and the at least one processor interconnected by a line;
the at least one processor invoking the instructions in the memory to cause an offsite online device of the virtual reality system to perform an offsite online method of the virtual reality system of any of claims 1-7.
10. A computer-readable storage medium, having stored thereon a computer program, wherein the computer program, when executed by a processor, implements a method of offsite online of a virtual reality system according to any one of claims 1-7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010346433.8A CN111562841B (en) | 2020-04-27 | 2020-04-27 | Off-site online method, device, equipment and storage medium of virtual reality system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010346433.8A CN111562841B (en) | 2020-04-27 | 2020-04-27 | Off-site online method, device, equipment and storage medium of virtual reality system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111562841A true CN111562841A (en) | 2020-08-21 |
| CN111562841B CN111562841B (en) | 2023-06-20 |
Family
ID=72071807
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010346433.8A Active CN111562841B (en) | 2020-04-27 | 2020-04-27 | Off-site online method, device, equipment and storage medium of virtual reality system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111562841B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113900729A (en) * | 2021-09-23 | 2022-01-07 | 深圳市瑞立视多媒体科技有限公司 | Tracking equipment parameter configuration method and device of SteamVR system |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101511117A (en) * | 2009-04-08 | 2009-08-19 | 杭州华三通信技术有限公司 | Two-layer cross-network segment communicating method, system and equipment |
| CN102170462A (en) * | 2011-03-16 | 2011-08-31 | 西安电子科技大学 | Remote collaboration method of product design model |
| CN108769292A (en) * | 2018-06-29 | 2018-11-06 | 北京百悟科技有限公司 | Message data processing method and processing device |
| CN110794952A (en) * | 2018-08-01 | 2020-02-14 | 北京鑫媒世纪科技发展有限公司 | Virtual reality cooperative processing method, device and system |
-
2020
- 2020-04-27 CN CN202010346433.8A patent/CN111562841B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101511117A (en) * | 2009-04-08 | 2009-08-19 | 杭州华三通信技术有限公司 | Two-layer cross-network segment communicating method, system and equipment |
| CN102170462A (en) * | 2011-03-16 | 2011-08-31 | 西安电子科技大学 | Remote collaboration method of product design model |
| CN108769292A (en) * | 2018-06-29 | 2018-11-06 | 北京百悟科技有限公司 | Message data processing method and processing device |
| CN110794952A (en) * | 2018-08-01 | 2020-02-14 | 北京鑫媒世纪科技发展有限公司 | Virtual reality cooperative processing method, device and system |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113900729A (en) * | 2021-09-23 | 2022-01-07 | 深圳市瑞立视多媒体科技有限公司 | Tracking equipment parameter configuration method and device of SteamVR system |
| CN113900729B (en) * | 2021-09-23 | 2024-04-12 | 深圳市瑞立视多媒体科技有限公司 | Tracking equipment parameter configuration method and device of SteamVR system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111562841B (en) | 2023-06-20 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109313484B (en) | Virtual reality interaction system, method and computer storage medium | |
| CN107168532B (en) | Virtual synchronous display method and system based on augmented reality | |
| CN104536579B (en) | Interactive three-dimensional outdoor scene and digital picture high speed fusion processing system and processing method | |
| CN106503671B (en) | The method and apparatus for determining human face posture | |
| US20160217615A1 (en) | Method and System for Implementing a Multi-User Virtual Environment | |
| CN106125903B (en) | Multi-person interaction system and method | |
| CN104346612B (en) | Information processing unit and display methods | |
| JP2013061937A (en) | Combined stereo camera and stereo display interaction | |
| CN108564641B (en) | Expression capturing method and device based on UE engine | |
| Ryden et al. | Proxy method for fast haptic rendering from time varying point clouds | |
| CN109298629A (en) | For providing the fault-tolerant of robust tracking to realize from non-autonomous position of advocating peace | |
| CN105252532A (en) | Method of cooperative flexible attitude control for motion capture robot | |
| CN110728739A (en) | Virtual human control and interaction method based on video stream | |
| JP2020065229A (en) | Video communication method, video communication device, and video communication program | |
| CN113426117A (en) | Virtual camera shooting parameter acquisition method and device, electronic equipment and storage medium | |
| CN111562841B (en) | Off-site online method, device, equipment and storage medium of virtual reality system | |
| CN111885366A (en) | Three-dimensional display method and device for virtual reality screen, storage medium and equipment | |
| US10582190B2 (en) | Virtual training system | |
| CN108553888A (en) | Augmented reality exchange method and device | |
| CN114155288A (en) | AR space visual three-dimensional reconstruction method controlled through gestures | |
| WO2022176450A1 (en) | Information processing device, information processing method, and program | |
| CN115131528A (en) | Virtual reality scene determination method, device and system | |
| JP2004310470A (en) | System for deciding and combining eye-gaze position and computer-executable program | |
| Ikoma et al. | Virtual Reality Implementation of Steering Hands Motion in Driving Simulator with Unity Technology | |
| CN117911632B (en) | Human body node three-dimensional virtual character action reconstruction method, equipment and computer readable storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |