CN111562841B - Off-site online method, device, equipment and storage medium of virtual reality system - Google Patents
Off-site online method, device, equipment and storage medium of virtual reality system Download PDFInfo
- Publication number
- CN111562841B CN111562841B CN202010346433.8A CN202010346433A CN111562841B CN 111562841 B CN111562841 B CN 111562841B CN 202010346433 A CN202010346433 A CN 202010346433A CN 111562841 B CN111562841 B CN 111562841B
- Authority
- CN
- China
- Prior art keywords
- address
- virtual reality
- online
- virtual
- image display
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L12/00—Data switching networks
- H04L12/28—Data switching networks characterised by path configuration, e.g. LAN [Local Area Networks] or WAN [Wide Area Networks]
- H04L12/46—Interconnection of networks
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/12—Protocols specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/14—Systems for two-way working
Landscapes
- Engineering & Computer Science (AREA)
- Signal Processing (AREA)
- Computer Networks & Wireless Communication (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- General Health & Medical Sciences (AREA)
- Computing Systems (AREA)
- Medical Informatics (AREA)
- Health & Medical Sciences (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Multimedia (AREA)
- Information Transfer Between Computers (AREA)
- Computer And Data Communications (AREA)
Abstract
The invention relates to the technical field of virtual reality, and discloses a remote online method, device and equipment of a virtual reality system and a storage medium, which are used for realizing online interaction of the remote virtual reality system. The method comprises the following steps: acquiring an online request for establishing communication connection between a first VR device and a second VR device; reading a first IP address of the first VR device and a second IP address of the second VR device from a preset virtual reality peripheral network library according to the online request; creating a remote online IP address of the first VR device and the second VR device according to the first IP address, the second IP address and a virtual reality peripheral network protocol; according to the remote online IP address, a communication connection from the first VR device to the second VR device is established, and in the embodiment of the invention, the communication connection based on the public network is realized through adjusting the connection IP in the transmission protocol, so that the purpose of communication interaction of the remote VR devices is realized.
Description
Technical Field
The present invention relates to the field of virtual reality technologies, and in particular, to a remote online method, device, equipment, and storage medium for a virtual reality system.
Background
The internet technology is continuously updated, and technical schemes such as VR, AR and the like are generated under the pursuit of continuously updating the experience of people. The VR technology is continuously updated and developed, real data are presented in the network in real time and interacted with the data of the virtual network, so that the sense experience and the image processing technology of people are improved.
In the prior art, the interaction of the multiple virtual spaces is realized based on a local area network, wherein the content of the interaction of the multiple virtual spaces is training, game and true practice. The implementation of the interaction scheme of a plurality of people and a large space based on the local area network can lead to regional limitation to reduce the application range of VR technology, so that the multi-person virtual space different-place interaction scheme based on the public network is needed, and inconvenience brought by regional limitation is reduced.
Disclosure of Invention
The invention mainly aims to solve the technical problem of how to realize the remote communication connection based on VR technology.
The first aspect of the present invention provides a remote online method of a virtual reality system, including:
acquiring an online request for establishing communication connection between a first VR device and a second VR device, wherein the first VR device and the second VR device are different-place devices;
reading a first IP address of the first VR device and a second IP address of the second VR device from a preset virtual reality peripheral network library according to the online request, wherein at least one of the first IP address and the second IP address is a public network IP address;
Creating a remote online IP address of the first VR device and the second VR device according to the first IP address, the second IP address and a virtual reality peripheral network protocol;
and establishing a communication connection from the first VR device to the second VR device according to the off-site online IP address.
Optionally, in a first implementation manner of the first aspect of the present invention, the reading, according to the online request, the first IP address of the first VR device and the second IP address of the second VR device from a preset virtual reality peripheral network library includes:
inquiring the states of the intranet ports of the first VR equipment and the second VR equipment respectively recorded in the preset virtual reality peripheral network according to the online request, and judging whether the states of the intranet ports are in an open state or not;
if the first intranet port of the first VR device is not in an open state, determining that the first IP address is a first public network IP address and the second IP address is a second intranet IP address, and reading the corresponding IP address from a preset virtual reality peripheral network library;
if the first intranet port of the first VR device is in an open state, determining that the first IP address is a first intranet IP address, and reading the state of the second intranet port corresponding to the second IP address;
Judging whether the second intranet port is in an open state or not;
and if the second intranet port is not in the opened state, confirming that the second IP address is a public network IP address, and reading the corresponding IP address from a preset virtual reality peripheral network library.
Optionally, in a second implementation manner of the first aspect of the present invention, the creating the off-site online IP address of the first VR device and the second VR device according to the first IP address, the second IP address, and the virtual reality peripheral network protocol includes:
receiving an IP configuration command and reading configuration data in the IP configuration command;
generating a remote online IP address from the first public network IP address and the second intranet IP address according to the configuration data and a virtual reality peripheral network protocol; or generating the remote online IP address by the first public network IP address and the second public network IP address according to the configuration data and the virtual reality peripheral network protocol.
Optionally, in a third implementation manner of the first aspect of the present invention, the first VR device includes a first optical motion collector and a first image display, the second VR device includes a second optical motion collector and a second image display, and after the establishing a communication connection from the first VR device to the second VR device according to the off-site online IP address, the method further includes:
Judging whether the state of the communication connection is a communication state or not;
if the virtual images are in the communication state, synchronizing the virtual images in the first image display and the second image display through the communication connection;
if the communication state is not the connected state, updating a first IP address and a second IP address in the preset virtual reality peripheral network library, and reestablishing communication connection from the first VR device to the second VR device based on the updated first IP address, second IP address and virtual reality peripheral network protocol.
Optionally, in a fourth implementation manner of the first aspect of the present invention, synchronizing the virtual images in the first image display and the second image display through the communication connection includes:
acquiring a first virtual image displayed in a first image display and acquiring a second virtual image displayed in the second image display;
analyzing the first virtual image and the second virtual image, integrating the first virtual image and the second virtual image, and generating a synchronous virtual image;
displaying the synchronized virtual image in the first display and the second display.
Optionally, in a fifth implementation manner of the first aspect of the present invention, the off-site online method of the virtual reality system further includes:
and if the first IP address and the second IP address are not public network IP addresses, displaying notification information that the remote connection cannot be realized in the first image display and the second image display.
Optionally, in a sixth implementation manner of the first aspect of the present invention, after the synchronizing the virtual images in the first image display and the second image display through the communication connection, the method further includes:
acquiring operation commands in the first optical action collector and the second optical action collector, and acquiring action three-dimensional coordinate data acquired by the first optical action collector and the second optical action collector;
according to a preset algorithm, the motion three-dimensional coordinate data are calculated to obtain three-dimensional attitude data;
analyzing the operation command to obtain an adjustment instruction for adjusting the three-dimensional posture data;
generating an updated virtual image according to the adjustment instruction and the three-dimensional gesture data;
and displaying the updated virtual image in the first image display and the second image display through the communication connection.
The second aspect of the present invention provides a remote online device of a virtual reality system, comprising:
the device comprises an acquisition module, a communication module and a communication module, wherein the acquisition module is used for acquiring an online request for establishing communication connection from a first VR device to a second VR device, and the first VR device and the second VR device are different-place devices;
the reading module is used for reading a first IP address of the first VR device and a second IP address of the second VR device from a preset virtual reality peripheral network library according to the online request, wherein at least one of the first IP address and the second IP address is a public network IP address;
the construction module is used for creating a remote online IP address of the first VR device and the second VR device according to the first IP address, the second IP address and a virtual reality peripheral network protocol;
and the establishing module is used for establishing communication connection from the first VR equipment to the second VR equipment according to the off-site online IP address.
Optionally, in a first implementation manner of the second aspect of the present invention, the reading module is specifically configured to:
inquiring the states of the intranet ports of the first VR equipment and the second VR equipment respectively recorded in the preset virtual reality peripheral network according to the online request, and judging whether the states of the intranet ports are in an open state or not;
If the first intranet port of the first VR device is not in an open state, determining that the first IP address is a first public network IP address and the second IP address is a second intranet IP address, and reading the corresponding IP address from a preset virtual reality peripheral network library;
if the first intranet port of the first VR device is in an open state, determining that the first IP address is a first intranet IP address, and reading the state of the second intranet port corresponding to the second IP address;
judging whether the second intranet port is in an open state or not;
and if the second intranet port is not in the opened state, confirming that the second IP address is a public network IP address, and reading the corresponding IP address from a preset virtual reality peripheral network library.
Optionally, in a second implementation manner of the second aspect of the present invention, the building module is specifically configured to:
receiving an IP configuration command and reading configuration data in the IP configuration command;
generating a remote online IP address from the first public network IP address and the second intranet IP address according to the configuration data and a virtual reality peripheral network protocol; or generating the remote online IP address by the first public network IP address and the second public network IP address according to the configuration data and the virtual reality peripheral network protocol.
Optionally, in a third implementation manner of the second aspect of the present invention, the off-site online device of the virtual reality system further includes:
the state judging module is used for judging whether the state of the communication connection is a communication state or not;
the synchronization module is used for synchronizing virtual images in the first image display and the second image display through the communication connection if the state of the communication connection is a communication state;
and the reconstruction module is used for updating the first IP address and the second IP address in the preset virtual reality peripheral network library if the communication connection state is a communication state, and reestablishing the communication connection from the first VR device to the second VR device based on the updated first IP address, second IP address and virtual reality peripheral network protocol.
Optionally, in a fourth implementation manner of the second aspect of the present invention, the synchronization module includes:
an acquisition unit configured to acquire a first virtual image displayed in a first image display and acquire a second virtual image displayed in the second image display;
the generation unit is used for analyzing the first virtual image and the second virtual image, integrating the first virtual image and the second virtual image and generating a synchronous virtual image;
And the display unit is used for displaying the synchronous virtual image in the first display and the second display.
Optionally, in a fifth implementation manner of the second aspect of the present invention, the off-site online device of the virtual reality system further includes:
and the notification module is used for displaying notification information which cannot be connected in different places in the first image display and the second image display if the first IP address and the second IP address are not public network IP addresses.
Optionally, in a sixth implementation manner of the second aspect of the present invention, the off-site online device of the virtual reality system further includes:
the acquisition module is used for acquiring operation commands in the first optical action acquirer and the second optical action acquirer and acquiring action three-dimensional coordinate data acquired by the first optical action acquirer and the second optical action acquirer;
the resolving module is used for resolving the motion three-dimensional coordinate data according to a preset algorithm to obtain three-dimensional posture data;
the analysis module is used for analyzing the operation command to obtain an adjustment instruction for adjusting the three-dimensional posture data;
the image generation module is used for generating an updated virtual image according to the adjustment instruction and the three-dimensional gesture data;
And the interactive display module is used for displaying the updated virtual image in the first image display and the second image display through the communication connection.
A third aspect of the present invention provides a remote online device of a virtual reality system, including: a memory and at least one processor, the memory having instructions stored therein, the memory and the at least one processor being interconnected by a line; the at least one processor invokes the instructions in the memory to cause the offsite online device of the virtual reality system to perform the offsite online method of the virtual reality system described above.
A fourth aspect of the present invention provides a computer readable storage medium having instructions stored therein, which when run on a computer, cause the computer to perform the off-site online method of a virtual reality system described above.
In the technical scheme provided by the invention, an online request for establishing communication connection between first VR equipment and second VR equipment is obtained, wherein the first VR equipment and the second VR equipment are different-place equipment; reading a first IP address of the first VR device and a second IP address of the second VR device from a preset virtual reality peripheral network library according to the online request, wherein at least one of the first IP address and the second IP address is a public network IP address; creating a remote online IP address of the first VR device and the second VR device according to the first IP address, the second IP address and a virtual reality peripheral network protocol; and establishing a communication connection from the first VR device to the second VR device according to the off-site online IP address. In the embodiment of the invention, the communication interaction purpose of the remote VR equipment is realized by establishing the communication connection of the remote VR equipment based on the public network through the adjustment of the transmission protocol.
Drawings
FIG. 1 is a diagram illustrating a first embodiment of a remote online method of a virtual reality system according to an embodiment of the invention;
FIG. 2 is a diagram illustrating a second embodiment of a remote online method of a virtual reality system according to an embodiment of the invention;
FIG. 3 is a diagram illustrating a third embodiment of a remote online method of a virtual reality system according to an embodiment of the invention;
FIG. 4 is a diagram illustrating a fourth embodiment of a remote online method of a virtual reality system according to an embodiment of the invention;
FIG. 5 is a diagram of a first embodiment of a remote connection device of a virtual reality system according to an embodiment of the invention;
FIG. 6 is a diagram of a second embodiment of a remote connection device of a virtual reality system according to an embodiment of the invention;
FIG. 7 is a diagram of a third embodiment of a remote connection device of a virtual reality system according to an embodiment of the invention;
fig. 8 is a schematic diagram of an embodiment of a remote online device of a virtual reality system according to an embodiment of the invention.
Detailed Description
The embodiment of the invention provides a remote online method, a device, equipment and a storage medium of a virtual reality system, which are used for acquiring an online request for establishing communication connection from first VR equipment to second VR equipment, wherein the first VR equipment and the second VR equipment are remote equipment; reading a first IP address of the first VR device and a second IP address of the second VR device from a preset virtual reality peripheral network library according to the online request, wherein at least one of the first IP address and the second IP address is a public network IP address; creating a remote online IP address of the first VR device and the second VR device according to the first IP address, the second IP address and a virtual reality peripheral network protocol; and establishing a communication connection from the first VR device to the second VR device according to the off-site online IP address. In the embodiment of the invention, the communication interaction purpose of the remote VR equipment is realized by establishing the communication connection of the remote VR equipment based on the public network through the adjustment of the transmission protocol.
The terms "first," "second," "third," "fourth" and the like in the description and in the claims and in the above drawings, if any, are used for distinguishing between similar objects and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used may be interchanged where appropriate such that the embodiments described herein may be implemented in other sequences than those illustrated or otherwise described herein. Furthermore, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed or inherent to such process, method, article, or apparatus.
For ease of understanding, the following describes a specific flow of an embodiment of the present invention, referring to fig. 1, a first embodiment of a method for off-site online of a virtual reality system in an embodiment of the present invention includes:
101. acquiring an online request for establishing communication connection between a first VR device and a second VR device, wherein the first VR device and the second VR device are different-place devices;
In this embodiment, the first VR device and the second device being different devices from each other means that the two devices are not located in the same region, and the regions are different, mainly in different communication networks, and the communication networks are different in different local area networks. The online request of the VR device may be sent by any one of the different VR devices, when the first VR device is in the a place and the second VR device is in the B place, the first VR device on the a place sends the online request, and the online request may be that the VR device connects with the computer device, and the computer device operates the connection request, or the operator equipment VR device performs operation on a preset operation page of the VR device to complete sending the online request. VR devices are of two types, one being an all-in-one type, i.e., the VR device carries its own processor and communication module, which can operate in a virtual page of the VR device. And the other is that only the optical acquisition module and the display have no processor, so that the data acquired by the optical acquisition module is required to be processed by the computer equipment and displayed in the VR equipment after the processing is completed.
102. Reading a first IP address of the first VR device and a second IP address of the second VR device from a preset virtual reality peripheral network library according to the online request, wherein at least one of the first IP address and the second IP address is a public network IP address;
In this embodiment, the preset virtual reality peripheral network library includes communication IP addresses of VR devices on the a-land and the B-land, where data in the library is a communication IP address library configured mutually when the VR communication system is built in two places, and the communication IP address library is synchronously given to the VR communication devices in two places, and meanwhile, real-time update synchronization can be performed by monitoring changes of IP addresses of the devices in two places, where the first VR device and the second VR device are mutually connected, and the VRPN protocol can be adjusted by the communication IP addresses, and in practical application, the conventional VRPN protocol can be implemented, and only supports one IP and randomly generated port, which is not beneficial to connection of a public network, but through transformation of the VRPN protocol, the address format in the VRPN protocol is transformed, so that the combination of the IP addresses in two places is implemented, and thus, the same VRPN server exposes two ports of the public network and the internal network, and both the public network and the internal network are networks used for transmitting VRPN data. And reading the IP address displayed by the first VR equipment as X, reading the IP address displayed by the second VR equipment as Y, and then processing the data of the IP address. The first IP address and the second IP address are respectively provided with two external ports, and the ue4 is provided with an interface: playercotnroe- > islocalcontrol (); through this interface, the intranet is connected if true is returned, and the public network is connected if false is returned.
103. Creating a remote online IP address of the first VR device and the second VR device according to the first IP address, the second IP address and a virtual reality peripheral network protocol;
in this embodiment, the public network IP address and the intranet IP address of the first VR device and the second VR device are stored in the VRPN library, and if they are both intranet IP addresses, the first VR device and the second VR device are not connected, and the IP addresses that are connected in different places are not configured. Only if at least one of the first VR device and the second VR device is open, an online IP address from one public network port to the other device may be configured.
104. And establishing a communication connection from the first VR device to the second VR device according to the off-site online IP address.
In this embodiment, when the first IP address or the second IP address is a public network IP address, at least one of ports displayed by the VRPN protocol is supporting communication of the public network, and data transmission between the VR devices in different places is achieved through communication of the public network. When one of the IP addresses is a public network and the other is an intranet, the public network is used to realize the remote crossing of the data through a connection protocol of the public network and the intranet, and then the intranet is used to transmit the data to the VR equipment. And if the first IP address and the second IP address are both public network IP addresses, directly connecting the first VR device with the second VR device using public network communication. In addition, at present, many computer and mobile phone games are completed based on remote communication, and the communication speed of the VR environment can be ensured. The off-site online equipment of the invention can be a switching equipment consisting of routers.
In the embodiment of the invention, the communication interaction purpose of the remote VR equipment is realized by establishing the communication connection of the remote VR equipment based on the public network through the adjustment of the transmission protocol.
Referring to fig. 2, a second embodiment of a method for off-site online of a virtual reality system according to an embodiment of the invention includes:
201. acquiring an online request for establishing communication connection between a first VR device and a second VR device, wherein the first VR device and the second VR device are different-place devices;
202. inquiring the states of intranet ports of the first VR equipment and the second VR equipment respectively recorded in the preset virtual reality peripheral network according to the online request;
in this embodiment, the intranet ports of the first VR device and the second VR device recorded in the VRPN library are read, where the formal intranet ports are @ X and @ Y, respectively.
203. Judging whether the state of the intranet port is in an open state or not;
in this embodiment, judging the port state uses playercontnroe- > islocalcontrol () to query the port state of the intranet, and obtaining the function feedback information can obtain the state of the intranet port.
204. If the first intranet port of the first VR device is not in an open state, determining that the first IP address is a first public network IP address and the second IP address is a second intranet IP address, and reading the corresponding IP address from a preset virtual reality peripheral network library;
In this embodiment, if the data returned at the first intranet port X is "Nell" or "closed", the first IP address is determined as the public network IP address, and the second IP address and the data of the first IP address are queried from the VRPN library to obtain the corresponding data.
205. If the first intranet port of the first VR device is in an open state, determining that the first IP address is a first intranet IP address, and reading the state of the second intranet port corresponding to the second IP address;
in this embodiment, if the data returned at the first intranet port X is "open" or "present", the first IP address is determined to be the intranet IP address, and the port status of the second IP address needs to be queried, and similarly, the intranet port status is queried using playercontroller- > islocalcontrol ().
206. Judging whether the second intranet port is in an open state or not;
in this embodiment, playercontroller- > islocalcontrol () is used to query the intranet port state, and then feedback is obtained to determine whether it is in an on state.
207. If the second intranet port is not in an opened state, confirming that the second IP address is a public network IP address, and reading a corresponding IP address from a preset virtual reality peripheral network library;
In this embodiment, if the data returned by playercontnroe- > islocalcontrol () is "Nell" or "unopened", etc., the intranet port address of the first IP address is queried from the VRPN library and the public network port of the second IP address is queried.
208. Receiving an IP configuration command and reading configuration data in the IP configuration command;
in this embodiment, the IP configuration data are X and Y, and the obtained data is displayed on a display for confirmation by an operator or for modification and adjustment by the operator. After the configuration command is obtained, the data of the configuration is read.
209. Generating a remote online IP address by taking the first IP address as a public network IP address and the second IP address as an intranet IP address according to the configuration data and a virtual reality peripheral network protocol; the method comprises the steps of carrying out a first treatment on the surface of the
In this embodiment, the off-site online IP address is generated from the adjusted VRPN protocol and TCP/IP protocol according to the IP data X and Y. In another case, the first IP address is an intranet and the second IP address is a public network, and the generation of the remote online IP address similar to the generation of the first IP address as the public network IP address and the generation of the second IP address as the intranet IP address is not repeated. There is also a case where the first IP address is determined as the public network IP address and the second IP address is determined as the public network IP address, and then the off-site online IP address is generated
210. And establishing a communication connection from the first VR device to the second VR device according to the off-site online IP address.
In the embodiment of the invention, the communication interaction purpose of the remote VR equipment is realized by establishing the communication connection of the remote VR equipment based on the public network through the adjustment of the transmission protocol.
Referring to fig. 3, a third embodiment of a method for off-site online of a virtual reality system according to an embodiment of the invention includes:
301. acquiring an online request for establishing communication connection between a first VR device and a second VR device, wherein the first VR device and the second VR device are different-place devices;
302. reading a first IP address of the first VR device and a second IP address of the second VR device from a preset virtual reality peripheral network library according to the online request;
303. judging whether at least one public network IP address exists in the first IP address and the second IP address;
304. if the first IP address and the second IP address are not public network IP addresses, displaying notification information that the remote connection cannot be realized in the first image display and the second image display;
in this embodiment, when it is confirmed that the first IP address and the second IP address are both intranet IP addresses, notification information "you good, please check whether the network setting is an extranet public network setting, and" the remote connection cannot be performed at present "is displayed in the first image display and the second image display, so that the operator modifies the configuration to reestablish the remote communication connection.
306. Establishing a communication connection from the first VR device to the second VR device according to the off-site online IP address;
305. if yes, establishing a remote online IP address of the first VR device and the second VR device according to the first IP address, the second IP address and a virtual reality peripheral network protocol;
306. establishing a communication connection from the first VR device to the second VR device according to the off-site online IP address;
307. judging whether the state of the communication connection is a communication state or not;
in this embodiment, "detection information a" may be sent from the first IP address, recording the sending time: q time "then adds information after the second IP address receives the information," detect information a, record the send out time: q time, record receive time: and the W time is received, feedback information sent back by the second IP address is received to judge whether the difference value between the Q time and the W time exceeds a threshold value, if the difference value exceeds the threshold value, the communication state is not judged, and if the difference value does not exceed the threshold value, the communication state is judged.
308. If the virtual images are in the communication state, synchronizing the virtual images in the first image display and the second image display through the communication connection;
In this embodiment, when it is determined that the communication connection is in the connection state, it is necessary to synchronize data of the first VR device and the second VR device on the same virtual template, acquire image data from the first VR device and also acquire image data from the second VR device, then calculate data of the respective devices to present the two device data on the same virtual template, and present the updated virtual image on the first VR device and the second VR device.
309. If the communication state is not the connected state, updating a first IP address and a second IP address in the preset virtual reality peripheral network library, and reestablishing communication connection from the first VR device to the second VR device based on the updated first IP address, second IP address and virtual reality peripheral network protocol.
In this embodiment, the port settings of the first VR device and the second VR device are read again, and after judging whether they are public network ports, the connection can be determined again by confirming that the connection can be performed by using the TCP/IP protocol, so as to ensure that the communication connection can be stable.
In the embodiment of the invention, the communication interaction purpose of the remote VR equipment is realized by establishing the communication connection of the remote VR equipment based on the public network through the adjustment of the transmission protocol.
Referring to fig. 4, a fourth embodiment of a method for off-site online of a virtual reality system according to an embodiment of the invention includes:
401. Acquiring an online request for establishing communication connection between a first VR device and a second VR device, wherein the first VR device and the second VR device are different-place devices;
402. reading a first IP address of the first VR device and a second IP address of the second VR device from a preset virtual reality peripheral network library according to the online request, wherein at least one of the first IP address and the second IP address is a public network IP address;
403. creating a remote online IP address of the first VR device and the second VR device according to the first IP address, the second IP address and a virtual reality peripheral network protocol;
404. establishing a communication connection from the first VR device to the second VR device according to the off-site online IP address;
405. judging whether the state of the communication connection is a communication state or not;
406. if not, updating a first IP address and a second IP address in the preset virtual reality peripheral network library, and reestablishing communication connection from the first VR device to the second VR device based on the updated first IP address, second IP address and virtual reality peripheral network protocol;
407. if yes, acquiring a first virtual image displayed in a first image display and acquiring a second virtual image displayed in a second image display;
In this embodiment, the first virtual image is read from the first image display using the communication connection, and the second virtual image is obtained over the communication connection using the TCP/IP protocol as well.
408. Analyzing the first virtual image and the second virtual image, integrating the first virtual image and the second virtual image, and generating a synchronous virtual image;
in this embodiment, the image data and the virtual template type of the first virtual image are read, the image data and the virtual template type of the second virtual image are also read, then the image data in the first virtual image and the image data in the second virtual image are displayed in the virtual templates, and then the generated image data are displayed in the same type of virtual templates to generate the synchronous virtual image.
409. Displaying the synchronized virtual image in the first display and the second display;
in this embodiment, the synchronous virtual images are displayed on the first VR device and the second VR device simultaneously, and the display frame number of the images can be increased during display, so that the images are refreshed at a speed of 120 frames per second, and thus the images seen in the eyes of the first VR device and the second VR device are basically consistent.
410. Acquiring operation commands in the first optical action collector and the second optical action collector, and acquiring action three-dimensional coordinate data acquired by the first optical action collector and the second optical action collector;
In this embodiment, an optical collector camera built in the VR device is used to capture the motion of a person, and a rigid body optical sensor attached to the body of the person is used to obtain three-dimensional coordinate data of the motion of the person. An operation command is attached to the optical collector, and the three-dimensional coordinate data of the motion, such as a rotation command, can be adjusted, so that the orientation of the three-dimensional posture data can be modified.
411. According to a preset algorithm, the motion three-dimensional coordinate data are calculated to obtain three-dimensional attitude data;
in this embodiment, in the developed Tenoomi software, the obtained three-dimensional data may be parsed, the three-dimensional data may be resolved, and the three-dimensional data may be parsed by an algorithm preset by Tenoomi, to obtain three-dimensional posture data. The three-dimensional gesture data includes details of a person's hand orientation, face orientation, hand orientation, body twist angle, and the like.
412. Analyzing the operation command to obtain an adjustment instruction for adjusting the three-dimensional posture data;
in this embodiment, the operation command may be a human visual angle rotation adjustment, control of firearms in a rifle game, grabbing objects in a virtual interface, throwing objects in a virtual interface, etc.
413. Generating an updated virtual image according to the adjustment instruction and the three-dimensional gesture data;
In this embodiment, the virtual image is updated in the virtual interface according to the three-dimensional pose data and the adjustment instruction, and is adjusted at a speed of 120 frames, so that the person feels like changing the items of the virtual interface in real time.
414. And displaying the updated virtual image in the first image display and the second image display through the communication connection.
In this embodiment, the generated updated virtual image is displayed in the VR device, and the network speed measurement may be set to change corresponding to the updated frame number. If the network speed is measured to be 1M/s, the virtual image in the display is updated with an update speed of 300 frames/s, and if the network speed is measured to be 120KB/s, the virtual image is updated with 60 frames/s, and the update speed can be adjusted at any time.
In the embodiment of the invention, the communication interaction purpose of the remote VR equipment is realized by establishing the communication connection of the remote VR equipment based on the public network through the adjustment of the transmission protocol.
The foregoing describes a remote connection method of a virtual reality system in an embodiment of the present invention, and the following describes a remote connection device of a virtual reality system in an embodiment of the present invention, referring to fig. 5, a first embodiment of the remote connection device of a virtual reality system in an embodiment of the present invention includes:
An obtaining module 501, configured to obtain an online request for establishing a communication connection between a first VR device and a second VR device, where the first VR device and the second VR device are different devices;
a reading module 502, configured to read, according to the online request, a first IP address of the first VR device and a second IP address of the second VR device from a preset virtual reality peripheral network library, where at least one of the first IP address and the second IP address is a public network IP address;
a building module 503, configured to create a remote online IP address of the first VR device and the second VR device according to the first IP address, the second IP address, and a virtual reality peripheral network protocol;
an establishing module 504 is configured to establish a communication connection from the first VR device to the second VR device according to the off-site online IP address.
In the embodiment of the invention, the communication interaction purpose of the remote VR equipment is realized by establishing the communication connection of the remote VR equipment based on the public network through the adjustment of the transmission protocol.
Referring to fig. 6, a second embodiment of a remote connection device of a virtual reality system according to an embodiment of the invention includes:
an obtaining module 601, configured to obtain an online request for establishing a communication connection between a first VR device and a second VR device, where the first VR device and the second VR device are different devices;
A reading module 602, configured to read, according to the online request, a first IP address of the first VR device and a second IP address of the second VR device from a preset virtual reality peripheral network library, where at least one of the first IP address and the second IP address is a public network IP address;
a building module 603, configured to create a remote online IP address of the first VR device and the second VR device according to the first IP address, the second IP address, and a virtual reality peripheral network protocol;
an establishing module 604 is configured to establish a communication connection from the first VR device to the second VR device according to the off-site online IP address.
Optionally, the reading module 602 is specifically configured to: inquiring the states of the intranet ports of the first VR equipment and the second VR equipment respectively recorded in the preset virtual reality peripheral network according to the online request, and judging whether the states of the intranet ports are in an open state or not; if the first intranet port of the first VR device is not in an open state, determining that the first IP address is a first public network IP address and the second IP address is a second intranet IP address, and reading the corresponding IP address from a preset virtual reality peripheral network library; if the first intranet port of the first VR device is in an open state, determining that the first IP address is a public network IP address, and reading the state of the second intranet port corresponding to the second IP address; judging whether the second intranet port is in an open state or not; and if the second intranet port is not in the opened state, confirming that the second IP address is a public network IP address, and reading the corresponding IP address from a preset virtual reality peripheral network library.
Optionally, the building module 603 is specifically configured to: receiving an IP configuration command and reading configuration data in the IP configuration command; generating a remote online IP address from the first public network IP address and the second intranet IP address according to the configuration data and a virtual reality peripheral network protocol; or generating the remote online IP address by the first public network IP address and the second public network IP address according to the configuration data and the virtual reality peripheral network protocol.
Wherein, the off-site online device of the virtual reality system further comprises:
a notification module 605 configured to display notification information that the remote connection cannot be performed in the first image display and the second image display if the first IP address and the second IP address are not public IP addresses
Wherein, the off-site online device of the virtual reality system further comprises:
a state judging module 606, configured to judge whether the state of the communication connection is a connected state;
a synchronizing module 607, configured to synchronize, if the status of the communication connection is a connected status, virtual images in the first image display and the second image display through the communication connection;
And a rebuilding module 608, configured to update the first IP address and the second IP address in the preset virtual reality peripheral network library if the state of the communication connection is a connected state, and rebuild the communication connection from the first VR device to the second VR device based on the updated first IP address, second IP address and virtual reality peripheral network protocol.
Wherein the synchronization module 607 comprises:
an acquisition unit 6071 for acquiring a first virtual image displayed in a first image display and acquiring a second virtual image displayed in the second image display;
a generating unit 6072 for analyzing the first virtual image and the second virtual image, integrating the first virtual image and the second virtual image, and generating a synchronous virtual image;
and a display unit 6073 for displaying the synchronized virtual image in the first display and the second display.
Wherein, the off-site online device of the virtual reality system further comprises:
the acquisition module 609 is configured to acquire operation commands in the first optical motion collector and the second optical motion collector, and acquire motion three-dimensional coordinate data acquired by the first optical motion collector and the second optical motion collector;
The resolving module 610 is configured to resolve the motion three-dimensional coordinate data according to a preset algorithm to obtain three-dimensional gesture data;
the parsing module 611 is configured to parse the operation command to obtain an adjustment instruction for adjusting the three-dimensional gesture data;
an image generation module 612, configured to generate an updated virtual image according to the adjustment instruction and the three-dimensional gesture data;
an interactive display module 613, configured to display the updated virtual image on the first image display and the second image display through the communication connection.
In the embodiment of the invention, the communication interaction purpose of the remote VR equipment is realized by establishing the communication connection of the remote VR equipment based on the public network through the adjustment of the transmission protocol.
In practical applications, the above-mentioned off-site online device of the virtual reality system may specifically be composed of the following frame structures, as shown in fig. 7, where the device includes an RTS hardware system 701, a VRPC hardware system 702, and a routing switch 703 for implementing communication connection of the two-site virtual reality system;
in this embodiment, the VRPC hardware system 702 includes a data processing device 7021, where the data processing device 7021 is provided with a Tenoomi system, and the Tenoomi system is whole body motion capture gesture analysis software, and is configured to process tracker data acquired by the RTS hardware system 701, so as to construct a corresponding relationship between an actual application scene and a virtual reality scene. The VRPC hardware system 702 further includes a virtual image display 7022, where the virtual image display 7022 is configured to display a virtual reality scene, the virtual image display 7022 may be a display in the VR device, and the virtual image display 7022 may display processing data content for a computer display screen at a computer end.
In this embodiment, the RTS hardware system 701 includes a positioning device (Tracker) 7011 and an optical acquisition camera 7012, where the positioning device (Tracker) 7011 is an integral device composed of rigid body data collectors attached to the whole body for acquiring the body motion gesture, each rigid body data collector is rigid body data for acquiring at the attachment point, and the rigid body data is a three-dimensional stereo data matrix formed by each rigid body collector by the mutual relationship. The optical acquisition camera 7012 acquires the rigid body data and then uploads the rigid body data to a positioning device (Tracker) 7011 for space positioning, wherein the Tracker is a three-dimensional space position for tracking the whole body movement by target tracking software, so that 3D coordinate data of a target object are obtained. The routing switch 703 includes routing switches 7031 deployed at two locations, respectively. The routing switch 7031 can access the public network port and the intranet port of the routing switch 7031 deployed in different places when passing through the public network port. The routing switch 7031, when passing through its own intranet port, has access to only the intranet port of the routing switch 7031 that is deployed in a different place. When the two deployment route switches 7031 in different places use public network ports for communication, public network cloud can be utilized for data communication. When the routing switch 7031 is deployed in two places, one using a public network port and the other using an intranet port, communication can be achieved by using mesh communication GC (Grid Communication) at one end of the routing switch 7031 using the intranet port.
In the embodiment of the invention, the communication interaction purpose of the remote VR equipment is realized by establishing the communication connection of the remote VR equipment based on the public network through the adjustment of the transmission protocol.
The above-mentioned fig. 5, fig. 6, and fig. 7 describe the off-site online device of the virtual reality system in the embodiment of the invention in detail from the point of view of modularized functional entities, and the off-site online device of the virtual reality system in the embodiment of the invention is described in detail from the point of view of hardware processing.
Fig. 8 is a schematic structural diagram of a remote online device of a virtual reality system according to an embodiment of the invention, where the remote online device 800 of the virtual reality system may have a relatively large difference due to different configurations or performances, and may include one or more processors (central processing units, CPU) 810 (e.g., one or more processors) and a memory 820, and one or more storage media 830 (e.g., one or more mass storage devices) storing application programs 833 or data 832. Wherein memory 820 and storage medium 830 can be transitory or persistent. The program stored on the storage medium 830 may include one or more modules (not shown), each of which may include a series of instruction operations in the off-site online device 800 of the virtual reality system. Still further, the processor 810 may be configured to communicate with the storage medium 830 and execute a series of instruction operations in the storage medium 830 on the off-site online device 800 of the virtual reality system.
The virtual reality system based off-site online device 800 may also include one or more power supplies 840, one or more wired or wireless network interfaces 850, one or more input/output interfaces 860, and/or one or more operating systems 831, such as Windows Serve, mac OSX, unix, linux, freeBSD, and the like. It will be appreciated by those skilled in the art that the offsite online device architecture of the virtual reality system shown in fig. 8 is not limiting of the offsite online device based on the virtual reality system, and may include more or fewer components than shown, or may combine certain components, or a different arrangement of components.
The present invention also provides a computer readable storage medium, which may be a non-volatile computer readable storage medium, and may also be a volatile computer readable storage medium, where instructions are stored in the computer readable storage medium, when the instructions are executed on a computer, cause the computer to perform the steps of the off-site online method of the virtual reality system.
It will be clearly understood by those skilled in the art that, for convenience and brevity of description, the specific working process of the system or apparatus and unit described above may refer to the corresponding process in the foregoing method embodiment, which is not repeated herein.
The integrated units, if implemented in the form of software functional units and sold or used as stand-alone products, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present invention may be embodied essentially or in part or all of the technical solution or in part in the form of a software product stored in a storage medium, including instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the method according to the embodiments of the present invention. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a read-only memory (ROM), a random access memory (random access memory, RAM), a magnetic disk, or an optical disk, or other various media capable of storing program codes.
The above embodiments are only for illustrating the technical solution of the present invention, and not for limiting the same; although the invention has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical scheme described in the foregoing embodiments can be modified or some technical features thereof can be replaced by equivalents; such modifications and substitutions do not depart from the spirit and scope of the technical solutions of the embodiments of the present invention.
Claims (10)
1. The off-site online method of the virtual reality system is characterized by comprising the following steps of:
acquiring an online request for establishing communication connection between a first VR device and a second VR device, wherein the first VR device and the second VR device are different-place devices;
reading a first IP address of the first VR device and a second IP address of the second VR device from a preset virtual reality peripheral network library according to the online request, wherein at least one of the first IP address and the second IP address is a public network IP address;
creating a remote online IP address of the first VR device and the second VR device according to the first IP address, the second IP address and a virtual reality peripheral network protocol;
and establishing a communication connection from the first VR device to the second VR device according to the off-site online IP address.
2. The method of claim 1, wherein the reading the first IP address of the first VR device and the second IP address of the second VR device from the preset virtual reality peripheral network library according to the online request comprises:
inquiring the states of the intranet ports of the first VR equipment and the second VR equipment respectively recorded in the preset virtual reality peripheral network according to the online request, and judging whether the states of the intranet ports are in an open state or not;
If the first intranet port of the first VR device is not in an open state, determining that the first IP address is a first public network IP address and the second IP address is a second intranet IP address, and reading the corresponding IP address from a preset virtual reality peripheral network library;
if the first intranet port of the first VR device is in an open state, determining that the first IP address is a first intranet IP address, and reading the state of the second intranet port corresponding to the second IP address;
judging whether the second intranet port is in an open state or not;
and if the second intranet port is not in the open state, confirming that the second IP address is a second public network IP address, and reading the corresponding IP address from a preset virtual reality peripheral network library.
3. The method of claim 2, wherein,
the creating the off-site online IP address of the first VR device and the second VR device according to the first IP address, the second IP address, and the virtual reality peripheral network protocol includes:
receiving an IP configuration command and reading configuration data in the IP configuration command;
generating a remote online IP address from the first public network IP address and the second intranet IP address according to the configuration data and a virtual reality peripheral network protocol; or generating the remote online IP address by the first public network IP address and the second public network IP address according to the configuration data and the virtual reality peripheral network protocol.
4. The off-site online method of a virtual reality system according to claim 1, wherein the first VR device includes a first optical motion collector and a first image display, and the second VR device includes a second optical motion collector and a second image display, after the establishing the communication connection from the first VR device to the second VR device according to the off-site online IP address, further comprising:
judging whether the state of the communication connection is a communication state or not;
if the virtual images are in the communication state, synchronizing the virtual images in the first image display and the second image display through the communication connection;
if the communication state is not the connected state, updating a first IP address and a second IP address in the preset virtual reality peripheral network library, and reestablishing communication connection from the first VR device to the second VR device based on the updated first IP address, second IP address and virtual reality peripheral network protocol.
5. The off-site online method of a virtual reality system according to claim 4, wherein synchronizing virtual images in the first image display and the second image display via the communication connection comprises:
Acquiring a first virtual image displayed in a first image display and acquiring a second virtual image displayed in the second image display;
analyzing the first virtual image and the second virtual image, integrating the first virtual image and the second virtual image, and generating a synchronous virtual image;
displaying the synchronized virtual image in the first image display and the second image display.
6. The off-site online method of a virtual reality system according to claim 4 or 5, further comprising, after the synchronizing virtual images in the first image display and the second image display via the communication connection:
acquiring operation commands in the first optical action collector and the second optical action collector, and acquiring action three-dimensional coordinate data acquired by the first optical action collector and the second optical action collector;
according to a preset algorithm, the motion three-dimensional coordinate data are calculated to obtain three-dimensional attitude data;
analyzing the operation command to obtain an adjustment instruction for adjusting the three-dimensional posture data;
generating an updated virtual image according to the adjustment instruction and the three-dimensional gesture data;
And displaying the updated virtual image in the first image display and the second image display through the communication connection.
7. The off-site online method of a virtual reality system according to claim 4, further comprising:
and if the first IP address and the second IP address are not public network IP addresses, displaying notification information that the remote connection cannot be realized in the first image display and the second image display.
8. A remote connection device of a virtual reality system, wherein the remote connection device of the virtual reality system comprises:
the device comprises an acquisition module, a communication module and a communication module, wherein the acquisition module is used for acquiring an online request for establishing communication connection from a first VR device to a second VR device, and the first VR device and the second VR device are different-place devices;
the reading module is used for reading a first IP address of the first VR device and a second IP address of the second VR device from a preset virtual reality peripheral network library according to the online request, wherein at least one of the first IP address and the second IP address is a public network IP address;
the construction module is used for creating a remote online IP address of the first VR device and the second VR device according to the first IP address, the second IP address and a virtual reality peripheral network protocol;
And the establishing module is used for establishing communication connection from the first VR equipment to the second VR equipment according to the off-site online IP address.
9. A offsite online device of a virtual reality system, the offsite online device of the virtual reality system comprising: a memory and at least one processor, the memory having instructions stored therein, the memory and the at least one processor being interconnected by a line;
the at least one processor invokes the instructions in the memory to cause the offsite online device of the virtual reality system to perform the offsite online method of the virtual reality system of any of claims 1-7.
10. A computer readable storage medium having a computer program stored thereon, which when executed by a processor, implements the off-site online method of a virtual reality system according to any of claims 1-7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010346433.8A CN111562841B (en) | 2020-04-27 | 2020-04-27 | Off-site online method, device, equipment and storage medium of virtual reality system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010346433.8A CN111562841B (en) | 2020-04-27 | 2020-04-27 | Off-site online method, device, equipment and storage medium of virtual reality system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111562841A CN111562841A (en) | 2020-08-21 |
| CN111562841B true CN111562841B (en) | 2023-06-20 |
Family
ID=72071807
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010346433.8A Active CN111562841B (en) | 2020-04-27 | 2020-04-27 | Off-site online method, device, equipment and storage medium of virtual reality system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111562841B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113900729B (en) * | 2021-09-23 | 2024-04-12 | 深圳市瑞立视多媒体科技有限公司 | Tracking equipment parameter configuration method and device of SteamVR system |
Family Cites Families (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101511117B (en) * | 2009-04-08 | 2010-11-10 | 杭州华三通信技术有限公司 | Two-layer cross-network segment communicating method, system and equipment |
| CN102170462B (en) * | 2011-03-16 | 2013-07-31 | 西安电子科技大学 | Remote collaboration method of product design model |
| CN108769292B (en) * | 2018-06-29 | 2021-04-13 | 北京百悟科技有限公司 | Message data processing method and device |
| CN110794952B (en) * | 2018-08-01 | 2023-11-28 | 北京鑫媒世纪科技发展有限公司 | Virtual reality cooperative processing method, device and system |
-
2020
- 2020-04-27 CN CN202010346433.8A patent/CN111562841B/en active Active
Also Published As
| Publication number | Publication date |
|---|---|
| CN111562841A (en) | 2020-08-21 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109313484B (en) | Virtual reality interaction system, method and computer storage medium | |
| US10726625B2 (en) | Method and system for improving the transmission and processing of data regarding a multi-user virtual environment | |
| CN102959616B (en) | Interactive reality augmentation for natural interaction | |
| CN104536579B (en) | Interactive three-dimensional outdoor scene and digital picture high speed fusion processing system and processing method | |
| US8994780B2 (en) | Video conferencing enhanced with 3-D perspective control | |
| CN104346612B (en) | Information processing unit and display methods | |
| JP2013061937A (en) | Combined stereo camera and stereo display interaction | |
| CN114223195A (en) | System and method for video communication using virtual camera | |
| CN108769517A (en) | A kind of method and apparatus carrying out remote assistant based on augmented reality | |
| CN109671141B (en) | Image rendering method and device, storage medium and electronic device | |
| WO2019019248A1 (en) | Virtual reality interaction method, device and system | |
| KR20130124188A (en) | System and method for eye alignment in video | |
| US20230067081A1 (en) | System and method for real-time creation and execution of a human Digital Twin | |
| Lan et al. | Development of a virtual reality teleconference system using distributed depth sensors | |
| CN111562841B (en) | Off-site online method, device, equipment and storage medium of virtual reality system | |
| CN108875966A (en) | A kind of machinery maintenance system and method using AR technology | |
| WO2023240999A1 (en) | Virtual reality scene determination method and apparatus, and system | |
| KR20210073428A (en) | Method and System for restoring objects and background and creating your own character for reality-based Social Network Services | |
| WO2022176450A1 (en) | Information processing device, information processing method, and program | |
| CN105843405A (en) | System and method based on 360-degree panoramic VR (virtual reality) holographic technique | |
| JP2004310470A (en) | System for deciding and combining eye-gaze position and computer-executable program | |
| CN117911632B (en) | Human body node three-dimensional virtual character action reconstruction method, equipment and computer readable storage medium | |
| Lee et al. | Augmented reality based vision system for network based mobile robot | |
| CN109062413A (en) | A kind of AR interactive system and method | |
| CN113596419B (en) | Method and device for controlling projection equipment and electronic equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |